00000001:02000400:1.0F:1790778770.022766:0:3304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_hostid 00000001:02000400:1.0:1790778788.794535:0:3526:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1790778790.725914:0:3589:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 549 MB/s 00000001:01000000:2.0F:1790778790.978738:0:3589:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 603 MB/s 00000001:01000000:2.0:1790778791.228008:0:3589:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5079 MB/s 00000020:02000000:0.0:1790778792.044645:0:3618:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_2_g696972c 00000400:02000000:2.0:1790778793.210796:0:3633:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.103@tcp [8/256/0/180] 00008000:02000000:3.0F:1790778796.905544:0:3782:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1790778856.876331:0:5750:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790778870.526659:0:6500:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790778870.526666:0:6500:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1790778870.526667:0:6500:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1790778870.526839:0:6500:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009a9e586b 00000080:02000400:1.0:1790778870.526850:0:6500:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:1.0:1790778870.547527:0:6500:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1790778870.547540:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790778870.547568:0:6500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000016b558bf) 00000020:00000080:1.0:1790778870.547583:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790778870.629490:0:6500:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790778870.629558:0:6500:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1790778870.652145:0:6500:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790778870.652519:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790778870.652526:0:6500:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790778870.652536:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936c65b 00000020:01000004:3.0:1790778870.652542:0:6500:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1790778870.652546:0:6500:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790778870.652550:0:6500:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009a9e586b from MGS 00000020:01000004:3.0:1790778870.652554:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790778870.652570:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000024dd176e) 00000020:00000080:3.0:1790778870.652581:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790778870.652668:0:6500:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009a9e586b from MGS, refs=2 00080000:01000000:3.0:1790778870.652672:0:6500:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790778870.652677:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936c669 00000100:00100000:3.0:1790778870.652852:0:6500:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790778870.654163:0:6500:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790778870.654171:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790778870.655030:0:6500:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790778870.655039:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790778870.655856:0:6500:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790778870.656419:0:6500:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790778870.656425:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790778870.657160:0:6500:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790778870.657167:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790778870.657647:0:6500:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790778870.657653:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790778870.658552:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778870.658555:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778870.658556:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778870.659076:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778870.659078:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778870.659079:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778870.659630:0:6500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790778870.665491:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1790778870.909259:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2067 MB/s 00000001:01000000:3.0:1790778871.158976:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4651 MB/s 00000001:01000000:3.0:1790778871.409481:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1315 MB/s 00000001:01000000:0.0:1790778871.659985:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1195 MB/s 00080000:10000000:2.0:1790778871.672529:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1790778871.694008:0:6500:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1790778871.695099:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790778871.695148:0:6500:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790778871.695183:0:6500:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790778871.696397:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790778871.696432:0:6500:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790778871.698506:0:6500:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790778871.700107:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790778871.700116:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790778871.710605:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790778871.710619:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:3.0:1790778871.721191:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778871.721251:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790778871.721281:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790778871.726858:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790778871.726912:0:6500:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.103@tcp' 00000020:01000004:1.0:1790778871.726914:0:6500:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790778871.726960:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.103@tcp (typ=mgc) 00000020:00000080:1.0:1790778871.726972:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.103@tcp (0000000086e88de4) 00000020:00000080:1.0:1790778871.726988:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790778871.727097:0:6500:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e857450f@MGC192.168.203.103@tcp: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1790778871.727250:0:6500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.103@tcp-0 is initialized 00000040:01000000:1.0:1790778871.727255:0:6500:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790778871.727946:0:6519:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1790778871.728107:0:6520:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790778871.728132:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.103@tcp (uuid d3110940-f102-4234-a689-7d64ccf7427e) 00000020:00000080:3.0:1790778871.728145:0:6500:0:(genops.c:1384:class_connect()) connect: client d3110940-f102-4234-a689-7d64ccf7427e, cookie 0xb1aa4014e936c677 00000100:00080000:3.0:1790778871.728155:0:6500:0:(import.c:545:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790778871.728162:0:6500:0:(import.c:666:import_select_connection()) MGC192.168.203.103@tcp: import 00000000e857450f using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790778871.728206:0:6500:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000aa25a430 x1877767663648896/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790778871.728223:0:6500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d3110940-f102-4234-a689-7d64ccf7427e->MGS 00000020:01000004:3.0:1790778871.728239:0:6500:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790778871.728262:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790778871.728273:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b3c8997b) 00000020:00000080:3.0:1790778871.728282:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790778871.730292:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa25a430 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3110940-f102-4234-a689-7d64ccf7427e:3648:1877767663648896:0@lo:250: 00000100:00100000:2.0:1790778871.730365:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778871.730782:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663648896 00000100:00100000:2.0:1790778871.730790:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663648896 00000100:00100000:2.0:1790778871.730830:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778871.730835:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2aca3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3648:x1877767663648896:12345-0@lo:250: 00010000:00080000:2.0:1790778871.730860:0:6515:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d3110940-f102-4234-a689-7d64ccf7427e@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1790778871.730900:0:6515:0:(genops.c:1384:class_connect()) connect: client d3110940-f102-4234-a689-7d64ccf7427e, cookie 0xb1aa4014e936c685 00000100:00080000:2.0:1790778871.731004:0:6515:0:(import.c:65:import_set_state_nolock()) 0000000091cd8c1d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790778871.731068:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2aca3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+5:3648:x1877767663648896:12345-0@lo:250: Request processed in 232us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778871.731076:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778871.731110:0:3648:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790778871.731119:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.103@tcp: connect to target with instance 0 00000100:00080000:2.0:1790778871.731125:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790778871.731129:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790778871.731132:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000e857450f MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790778871.731134:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790778871.731137:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790778871.731141:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa25a430 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3110940-f102-4234-a689-7d64ccf7427e:3648:1877767663648896:0@lo:250: 00000100:00100000:3.0:1790778871.742142:0:6500:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790778871.742331:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790778871.742338:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790778871.745743:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790778871.745767:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790778871.748435:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790778871.748447:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790778871.750516:0:6500:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790778871.750744:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790778871.750762:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790778871.751616:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790778871.751624:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790778871.793056:0:6500:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790778871.793264:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790778871.793276:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790778871.794856:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790778871.794870:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790778871.795876:0:6500:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790778871.796335:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790778871.796341:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790778871.796986:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790778871.796992:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790778871.797776:0:6500:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790778871.797994:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790778871.798000:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790778871.798782:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790778871.798789:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790778871.799665:0:6500:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790778871.799824:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790778871.799830:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790778871.800660:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790778871.800668:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790778871.819687:0:6500:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790778871.820080:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790778871.820087:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790778871.821609:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790778871.821621:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790778871.822550:0:6500:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790778871.822558:0:6500:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790778871.823575:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790778871.823604:0:6500:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1790778871.823610:0:6500:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790778871.823707:0:6500:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790778871.823740:0:6500:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1790778871.823745:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790778871.823747:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790778871.823758:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778871.823760:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790778871.823761:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778871.823763:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778871.823764:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790778871.823765:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790778871.823767:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790778871.823768:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790778871.823770:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778871.823771:0:6500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790778871.823774:0:6500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1790778871.823776:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790778871.823777:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790778871.823778:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778871.823779:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790778871.823780:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778871.823782:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778871.823783:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790778871.823784:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790778871.823784:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790778871.823785:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790778871.823786:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778871.823787:0:6500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790778871.823823:0:6500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790778871.823841:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b30328e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649024:0@lo:253: 00000100:00100000:2.0:1790778871.823937:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778871.823979:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078c19688 going to sleep for 11 seconds 00000100:00100000:0.0:1790778871.824051:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663649024 00000100:00100000:0.0:1790778871.824058:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663649024 00000100:00100000:0.0:1790778871.824115:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778871.824124:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001a07771e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+5:6500:x1877767663649024:12345-0@lo:253: 20000000:01000000:0.0:1790778871.824182:0:6518:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790778871.824185:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1790778871.824665:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790778871.824701:0:6518:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1790778871.825147:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778871.826347:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1790778871.826546:0:6518:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790778871.826558:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1790778871.826563:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1790778871.826566:0:6518:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1790778871.826578:0:6518:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1790778871.826708:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790778871.827031:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1790778871.827045:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790778871.827064:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1790778871.827080:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1790778871.827093:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1790778871.827140:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1790778871.827147:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1790778871.827158:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1790778871.827163:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1790778871.827299:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1790778871.827307:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1790778871.827321:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1790778871.827335:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1790778871.827361:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1790778871.827367:0:6518:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1790778871.827374:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790778871.827460:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1790778871.827471:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790778871.827485:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1790778871.827499:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1790778871.827513:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1790778871.827523:0:6518:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1790778871.827562:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1790778871.827571:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1790778871.827583:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1790778871.827598:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1790778871.827613:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1790778871.827630:0:6518:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1790778871.827657:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1790778871.827665:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1790778871.827676:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1790778871.827688:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1790778871.827734:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1790778871.827770:0:6518:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1790778871.827776:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1790778871.828433:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1790778871.828603:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1790778871.828622:0:6518:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.103@tcp for mdt 20000000:01000000:1.0:1790778871.828624:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:1.0:1790778871.828636:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1790778871.828641:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1790778871.828651:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1790778871.828656:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:1.0:1790778871.828666:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1790778871.828672:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1790778871.828682:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1790778871.828693:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1790778871.828717:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790778871.828720:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790778871.828724:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790778871.828791:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790778871.828793:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790778871.829104:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1790778871.829220:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1790778871.829236:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1790778871.829249:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1790778871.829256:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790778871.829258:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790778871.829617:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1790778871.829758:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1790778871.829778:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1790778871.829801:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1790778871.829813:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790778871.829815:0:6518:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1790778871.829821:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790778871.829823:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790778871.829827:0:6518:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1790778871.829832:0:6518:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1790778871.830130:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1790778871.830339:0:6518:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1790778871.837456:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1790778871.837488:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1790778871.837502:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1790778871.837522:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790778871.837544:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009874a336/0xb1aa4014e936c68c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778871.837561:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009874a336/0xb1aa4014e936c68c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778871.837570:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009874a336/0xb1aa4014e936c68c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778871.837576:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009874a336/0xb1aa4014e936c68c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778871.837583:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009874a336/0xb1aa4014e936c68c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778871.837589:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009874a336/0xb1aa4014e936c68c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778871.837596:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009874a336 already unused, calling callback (0000000053eea93d) 00010000:00010000:1.0:1790778871.837614:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009874a336/0xb1aa4014e936c68c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778871.837623:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009874a336/0xb1aa4014e936c68c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778871.837635:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009874a336/0xb1aa4014e936c68c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778871.837642:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009874a336/0xb1aa4014e936c68c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778871.837647:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009874a336/0xb1aa4014e936c68c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790778871.837666:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790778871.846631:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001a07771e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+5:6500:x1877767663649024:12345-0@lo:253: Request processed in 22502us (22688us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778871.846654:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790778871.846770:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b30328e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649024:0@lo:253: 10000000:01000000:2.0:1790778871.846784:0:6500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790778871.846793:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790778871.846795:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790778871.846796:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778871.846797:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1790778871.846799:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778871.846800:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778871.846801:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790778871.846803:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790778871.846804:0:6500:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790778871.846805:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778871.846807:0:6500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790778871.846823:0:6500:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009a9e586b from lustre-MDT0000 10000000:01000000:2.0:1790778871.846855:0:6500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790778871.846858:0:6500:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790778871.846862:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b773059cd40 10000000:01000000:2.0:1790778871.846865:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790778871.846873:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b773059cd40 from 1 10000000:01000000:2.0:1790778871.846875:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790778871.847058:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778871.847070:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778871.847079:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778871.847096:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b30328e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649152:0@lo:101: 00000100:00100000:2.0:1790778871.847130:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778871.847317:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000411a5189 going to sleep for 11 seconds 00000100:00100000:0.0:1790778871.847351:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663649152 00000100:00100000:0.0:1790778871.847358:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663649152 00000100:00100000:0.0:1790778871.847421:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790778871.847428:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e35c4b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+5:6500:x1877767663649152:12345-0@lo:101: 00010000:00010000:0.0:1790778871.847440:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778871.847453:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016f6694c/0xb1aa4014e936c69a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c693 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.847474:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016f6694c/0xb1aa4014e936c69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c693 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.847483:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016f6694c/0xb1aa4014e936c69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c693 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.847493:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016f6694c, rc 0) 00000100:00100000:0.0:1790778871.847568:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e35c4b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+6:6500:x1877767663649152:12345-0@lo:101: Request processed in 141us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778871.847574:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790778871.847630:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b30328e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649152:0@lo:101: 00010000:00010000:1.0:1790778871.847644:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778871.847651:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778871.847706:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fced5a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649280:0@lo:501: 00000100:00100000:1.0:1790778871.847742:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778871.847802:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bca41211 going to sleep for 11 seconds 00000100:00100000:0.0:1790778871.847876:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663649280 00000100:00100000:0.0:1790778871.847991:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663649280 00000100:00100000:0.0:1790778871.848016:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790778871.848022:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000048c59275 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+6:6500:x1877767663649280:12345-0@lo:501: 00000100:00100000:0.0:1790778871.848107:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000048c59275 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+6:6500:x1877767663649280:12345-0@lo:501: Request processed in 84us (363us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790778871.848114:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790778871.848310:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fced5a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649280:0@lo:501: 10000000:01000000:0.0:1790778871.848349:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790778871.848364:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848373:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778871.848381:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b77208a9000 10000000:01000000:0.0:1790778871.848385:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790778871.848390:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b77208a9000 10000000:01000000:0.0:1790778871.848392:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790778871.848395:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b77208a9000 from 1 10000000:01000000:0.0:1790778871.848397:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790778871.848426:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000c652e972/0xb1aa4014e936c6a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848433:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000c652e972/0xb1aa4014e936c6a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848439:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000c652e972/0xb1aa4014e936c6a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778871.848450:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649408:0@lo:101: 00000100:00100000:0.0:1790778871.848475:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778871.848495:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663649408 00000100:00100000:0.0:1790778871.848498:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663649408 00000100:00100000:0.0:1790778871.848516:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778871.848521:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000080da9f63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+6:6500:x1877767663649408:12345-0@lo:101: 00010000:00010000:0.0:1790778871.848527:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778871.848541:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002739f7d5/0xb1aa4014e936c6a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c6a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848554:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002739f7d5/0xb1aa4014e936c6a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c6a1 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848560:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002739f7d5/0xb1aa4014e936c6a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c6a1 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848566:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002739f7d5, rc 0) 00000100:00100000:0.0:1790778871.848589:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000080da9f63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+7:6500:x1877767663649408:12345-0@lo:101: Request processed in 68us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778871.848594:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778871.848621:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040106811 going to sleep for 11 seconds 00000100:00100000:0.0:1790778871.848633:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649408:0@lo:101: 00010000:00010000:0.0:1790778871.848642:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000c652e972/0xb1aa4014e936c6a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848649:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000c652e972/0xb1aa4014e936c6a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778871.848659:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790778871.848663:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000c652e972/0xb1aa4014e936c6a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848669:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000c652e972/0xb1aa4014e936c6a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778871.848675:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790778871.848678:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790778871.848688:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b77208a9000 10000000:01000000:0.0:1790778871.848690:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790778871.848693:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1790778871.848695:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790778871.848726:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848734:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848741:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778871.848764:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649536:0@lo:101: 00000100:00100000:0.0:1790778871.848789:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778871.848807:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663649536 00000100:00100000:0.0:1790778871.848811:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663649536 00000100:00100000:0.0:1790778871.848827:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790778871.848831:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f7b894c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+7:6500:x1877767663649536:12345-0@lo:101: 00010000:00010000:0.0:1790778871.848838:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778871.848845:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3804652/0xb1aa4014e936c6b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c6af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848855:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3804652/0xb1aa4014e936c6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c6af expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848861:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3804652/0xb1aa4014e936c6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c6af expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848866:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3804652, rc 0) 00000100:00100000:0.0:1790778871.848918:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f7b894c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+8:6500:x1877767663649536:12345-0@lo:101: Request processed in 86us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778871.848924:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790778871.848946:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040106811 going to sleep for 11 seconds 00000100:00100000:0.0:1790778871.848957:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649536:0@lo:101: 00010000:00010000:0.0:1790778871.848966:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778871.848972:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778871.849009:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649664:0@lo:501: 00000100:00100000:0.0:1790778871.849032:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778871.849049:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663649664 00000100:00100000:0.0:1790778871.849052:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663649664 00000100:00100000:0.0:1790778871.849067:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790778871.849072:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000469b283d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+8:6500:x1877767663649664:12345-0@lo:501: 00000100:00100000:0.0:1790778871.849156:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000469b283d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+9:6500:x1877767663649664:12345-0@lo:501: Request processed in 84us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778871.849163:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790778871.849255:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040106811 going to sleep for 11 seconds 00000100:00100000:0.0:1790778871.849267:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649664:0@lo:501: 00000100:00100000:0.0:1790778871.849289:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649792:0@lo:503: 00000100:00100000:0.0:1790778871.849327:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778871.849345:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663649792 00000100:00100000:0.0:1790778871.849349:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663649792 00000100:00100000:0.0:1790778871.849363:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790778871.849374:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d93c914f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+9:6500:x1877767663649792:12345-0@lo:503: 00000100:00100000:0.0:1790778871.849441:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d93c914f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+9:6500:x1877767663649792:12345-0@lo:503: Request processed in 68us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778871.849448:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790778871.849476:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000002368d181 going to sleep for 11 seconds 00000100:00100000:0.0:1790778871.849487:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663649792:0@lo:503: 00000100:00100000:3.0:1790778871.850628:0:6545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eea3d547 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:6545:1877767663649920:0@lo:502: 00000100:00100000:3.0:1790778871.850701:0:6545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778871.850784:0:6545:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d2c6fec going to sleep for 11 seconds 00000100:00100000:0.0:1790778871.850863:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663649920 00000100:00100000:0.0:1790778871.850869:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663649920 00000100:00100000:0.0:1790778871.851070:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790778871.851078:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d447f10a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+9:6545:x1877767663649920:12345-0@lo:502: 00000100:00100000:0.0:1790778871.851272:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d447f10a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+9:6545:x1877767663649920:12345-0@lo:502: Request processed in 194us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778871.851279:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790778871.851353:0:6545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eea3d547 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:6545:1877767663649920:0@lo:502: 00000020:01000000:1.0:1790778871.851375:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778871.851385:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778871.851391:0:6545:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790778871.851396:0:6545:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790778871.851398:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790778871.851411:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009a991275) 00000020:00000080:1.0:1790778871.851426:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790778871.851431:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790778871.851495:0:6545:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790778871.851500:0:6545:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936c6c4 00000020:00000080:1.0:1790778871.851731:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790778871.851736:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778871.851740:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778871.851741:0:6545:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790778871.851743:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778871.851746:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778871.851757:0:6545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790778871.851762:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790778871.851769:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e3024c89) 00000020:00000080:1.0:1790778871.851778:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790778871.851782:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790778871.851783:0:6545:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790778871.851786:0:6545:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790778871.851792:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790778871.851828:0:6545:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009a9e586b from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790778871.851853:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ee333461) 00000020:00000080:1.0:1790778871.851861:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790778871.851946:0:6545:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790778871.851951:0:6545:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936c6d9 00000020:00000080:1.0:1790778871.852042:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790778871.852048:0:6545:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790778871.852051:0:6545:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb1aa4014e936c6e0 00080000:01000000:1.0:1790778871.852055:0:6545:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790778871.852059:0:6545:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936c6e7 00080000:10000000:1.0:1790778871.852522:0:6545:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1790778871.852662:0:6545:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1790778871.858181:0:6545:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1790778871.953622:0:6545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1790778871.954115:0:6545:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1790778871.958194:0:6545:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1790778871.958558:0:6545:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790778871.961599:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001e9fb23d) 00000020:00000080:2.0:1790778871.961620:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790778871.961712:0:6545:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790778871.961732:0:6545:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936c6f5 00000020:00000080:2.0:1790778871.962340:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1790778871.963180:0:6545:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1790778871.987821:0:6545:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1790778872.007185:0:6545:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1790778872.014626:0:6545:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1790778872.030714:0:6545:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1790778872.035713:0:6545:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1790778872.037970:0:6545:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb1aa4014e936c6fc 00000020:00000080:2.0:1790778872.038479:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790778872.038492:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778872.038498:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778872.038501:0:6545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790778872.038504:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790778872.038508:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778872.038509:0:6545:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790778872.038512:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790778872.038514:0:6545:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790778872.038517:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778872.038519:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778872.038520:0:6545:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790778872.038523:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790778872.038527:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778872.038528:0:6545:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790778872.038532:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790778872.038572:0:6545:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1790778872.038637:0:6545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d7790eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:6545:1877767663650048:0@lo:502: 00000100:00100000:2.0:1790778872.038727:0:6545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778872.038935:0:6545:0:(client.c:2716:ptlrpc_set_wait()) set 0000000066f47376 going to sleep for 11 seconds 00000100:00100000:2.0:1790778872.042868:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663650048 00000100:00100000:2.0:1790778872.042993:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663650048 00000100:00100000:2.0:1790778872.043086:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790778872.043095:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009e26a1d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+9:6545:x1877767663650048:12345-0@lo:502: 00000100:00100000:2.0:1790778872.043334:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009e26a1d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+9:6545:x1877767663650048:12345-0@lo:502: Request processed in 240us (4618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778872.043341:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790778872.046949:0:6545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d7790eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:6545:1877767663650048:0@lo:502: 00000020:01000000:1.0:1790778872.047004:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778872.047014:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778872.047017:0:6545:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1790778872.047022:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1790778872.047231:0:6500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1790778872.047258:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790778872.047280:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.047292:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778872.047300:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b77208a9000 from 1 10000000:01000000:0.0:1790778872.047303:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790778872.047336:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.047343:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.047362:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778872.047390:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650176:0@lo:101: 00000100:00100000:0.0:1790778872.047449:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778872.047650:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7c3872 going to sleep for 11 seconds 00000100:00100000:3.0:1790778872.047799:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663650176 00000100:00100000:3.0:1790778872.047807:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663650176 00000100:00100000:3.0:1790778872.047843:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790778872.047850:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006ef12c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+9:6500:x1877767663650176:12345-0@lo:101: 00010000:00010000:3.0:1790778872.047863:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778872.047913:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001cb04060/0xb1aa4014e936c70a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c703 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778872.047937:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cb04060/0xb1aa4014e936c70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c703 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778872.047946:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001cb04060/0xb1aa4014e936c70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c703 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778872.047954:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001cb04060, rc 0) 00000100:00100000:3.0:1790778872.047995:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006ef12c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+10:6500:x1877767663650176:12345-0@lo:101: Request processed in 146us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778872.048002:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790778872.052020:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650176:0@lo:101: 00010000:00010000:0.0:1790778872.052049:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.052061:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778872.052586:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650304:0@lo:256: 00000100:00100000:0.0:1790778872.052651:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778872.052686:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7c3872 going to sleep for 11 seconds 00000100:00100000:3.0:1790778872.052866:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663650304 00000100:00100000:3.0:1790778872.052875:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663650304 00000100:00100000:3.0:1790778872.052939:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790778872.052946:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e2582525 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+10:6500:x1877767663650304:12345-0@lo:256: 20000000:01000000:3.0:1790778872.052965:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790778872.052971:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790778872.053039:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e2582525 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+10:6500:x1877767663650304:12345-0@lo:256: Request processed in 93us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778872.053046:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790778872.053187:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650304:0@lo:256: 10000000:01000000:0.0:1790778872.053847:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790778872.053873:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.054141:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778872.054150:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b77208a9000 from 1 10000000:01000000:0.0:1790778872.054153:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790778872.054188:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.054195:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.054203:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778872.054218:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650432:0@lo:101: 00000100:00100000:0.0:1790778872.054258:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778872.054326:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7c3872 going to sleep for 11 seconds 00000100:00100000:3.0:1790778872.056949:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663650432 00000100:00100000:3.0:1790778872.056963:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663650432 00000100:00100000:0.0:1790778872.059043:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790778872.059056:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b8c2226d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+10:6500:x1877767663650432:12345-0@lo:101: 00010000:00010000:0.0:1790778872.059074:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778872.059091:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee3ff3f8/0xb1aa4014e936c718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c711 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.059118:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee3ff3f8/0xb1aa4014e936c718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c711 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.059128:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee3ff3f8/0xb1aa4014e936c718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c711 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.059138:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee3ff3f8, rc 0) 00000100:00100000:0.0:1790778872.059216:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b8c2226d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+11:6500:x1877767663650432:12345-0@lo:101: Request processed in 162us (4958us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778872.059223:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790778872.061991:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce792b36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650432:0@lo:101: 00010000:00010000:1.0:1790778872.062021:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778872.062034:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778872.062117:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b3921 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650560:0@lo:501: 00000100:00100000:1.0:1790778872.062172:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778872.062274:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4ac1f05 going to sleep for 11 seconds 00000100:00100000:0.0:1790778872.070852:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663650560 00000100:00100000:0.0:1790778872.070866:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663650560 00000100:00100000:0.0:1790778872.071039:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790778872.071047:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e5372460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+11:6500:x1877767663650560:12345-0@lo:501: 00000100:00100000:0.0:1790778872.071302:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e5372460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+11:6500:x1877767663650560:12345-0@lo:501: Request processed in 256us (9130us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778872.071310:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790778872.072895:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b3921 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650560:0@lo:501: 00000100:00100000:1.0:1790778872.072959:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b3921 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650688:0@lo:503: 00000100:00100000:1.0:1790778872.073031:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778872.073076:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4ac1f05 going to sleep for 11 seconds 00000100:00100000:2.0:1790778872.073156:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663650688 00000100:00100000:2.0:1790778872.073163:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663650688 00000100:00100000:2.0:1790778872.073204:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790778872.073211:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fd8bdd76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+11:6500:x1877767663650688:12345-0@lo:503: 00000040:00080000:2.0:1790778872.073255:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790778872.073311:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fd8bdd76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+11:6500:x1877767663650688:12345-0@lo:503: Request processed in 100us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778872.073319:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790778872.073448:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b3921 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650688:0@lo:503: 00000040:00080000:1.0:1790778872.074433:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1790778872.074609:0:6500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790778872.074631:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790778872.074651:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.074663:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778872.074711:0:6500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790778872.074714:0:6500:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b77208a9000 10000000:01000000:0.0:1790778872.074847:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b77208a9000 10000000:01000000:0.0:1790778872.074852:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790778872.074858:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b77208a9000 from 1 10000000:01000000:0.0:1790778872.074861:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790778872.074909:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.074917:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.074926:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778872.074942:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049bf5897 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650816:0@lo:101: 00000100:00100000:0.0:1790778872.074990:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778872.075082:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1421b7a going to sleep for 11 seconds 00000100:00100000:2.0:1790778872.078013:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663650816 00000100:00100000:2.0:1790778872.078028:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663650816 00000100:00100000:2.0:1790778872.078135:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790778872.078144:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f59527cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+11:6500:x1877767663650816:12345-0@lo:101: 00010000:00010000:2.0:1790778872.078162:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778872.078182:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d400971d/0xb1aa4014e936c726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c71f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778872.078211:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d400971d/0xb1aa4014e936c726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c71f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778872.078221:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d400971d/0xb1aa4014e936c726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c71f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778872.078230:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d400971d, rc 0) 00000100:00100000:2.0:1790778872.078306:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f59527cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:6500:x1877767663650816:12345-0@lo:101: Request processed in 164us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778872.078328:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790778872.078408:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049bf5897 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650816:0@lo:101: 00010000:00010000:1.0:1790778872.078427:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778872.078435:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778872.078510:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b3921 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650944:0@lo:501: 00000100:00100000:1.0:1790778872.078545:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778872.085283:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d511b28e going to sleep for 11 seconds 00000100:00100000:0.0:1790778872.089019:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663650944 00000100:00100000:0.0:1790778872.089036:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663650944 00000100:00100000:0.0:1790778872.089099:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790778872.089107:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e572ed07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:6500:x1877767663650944:12345-0@lo:501: 00000100:00100000:0.0:1790778872.089328:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e572ed07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:6500:x1877767663650944:12345-0@lo:501: Request processed in 220us (10783us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778872.089337:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790778872.089983:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b3921 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663650944:0@lo:501: 00000100:00100000:1.0:1790778872.090038:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b3921 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663651072:0@lo:503: 00000100:00100000:1.0:1790778872.090097:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778872.090136:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d511b28e going to sleep for 11 seconds 00000100:00100000:0.0:1790778872.090211:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663651072 00000100:00100000:0.0:1790778872.090216:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663651072 00000100:00100000:0.0:1790778872.090251:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790778872.090258:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006aaffb30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:6500:x1877767663651072:12345-0@lo:503: 00000100:00100000:0.0:1790778872.090349:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006aaffb30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:6500:x1877767663651072:12345-0@lo:503: Request processed in 92us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778872.090355:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790778872.090460:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b3921 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663651072:0@lo:503: 00000100:00100000:1.0:1790778872.092239:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b3921 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:6550:1877767663651200:0@lo:502: 00000100:00100000:1.0:1790778872.092314:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778872.092385:0:6550:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fb9e0af2 going to sleep for 11 seconds 00000100:00100000:3.0:1790778872.094039:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663651200 00000100:00100000:3.0:1790778872.094053:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663651200 00000100:00100000:0.0:1790778872.094157:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790778872.094970:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005190c38e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:6550:x1877767663651200:12345-0@lo:502: 00000100:00100000:1.0:1790778872.095147:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005190c38e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:6550:x1877767663651200:12345-0@lo:502: Request processed in 981us (2834us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778872.095157:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790778872.096911:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b3921 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:6550:1877767663651200:0@lo:502: 00000020:01000004:0.0:1790778872.096993:0:6550:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790778872.097024:0:6550:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000909cfce2) 00000020:00000080:0.0:1790778872.097045:0:6550:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1790778872.097180:0:6550:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009a9e586b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790778872.097185:0:6550:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009a9e586b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790778872.097187:0:6550:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009a9e586b 4 00010000:00080000:0.0:1790778872.097215:0:6550:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000280c38c5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1790778872.105092:0:6550:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1790778872.105356:0:6550:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790778872.105400:0:6550:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790778872.105411:0:6550:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb1aa4014e936c734 00000100:00080000:2.0:1790778872.105421:0:6550:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790778872.105430:0:6550:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000280c38c5 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790778872.105466:0:6550:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002ec818fa x1877767663651328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790778872.105501:0:6550:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790778872.106580:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ec818fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663651328:0@lo:38: 00000100:00100000:3.0:1790778872.106661:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778872.107296:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edd7a0e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:6550:1877767663651456:0@lo:502: 00000100:00100000:0.0:1790778872.107348:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778872.107375:0:6550:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049345272 going to sleep for 11 seconds 00000100:00100000:2.0:1790778872.108946:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663651328 00000100:00100000:2.0:1790778872.108958:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663651328 00000100:00100000:2.0:1790778872.108997:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778872.109003:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ed322e6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663651328:12345-0@lo:38: 00000100:00100000:2.0:1790778872.109106:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ed322e6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663651328:12345-0@lo:38: Request processed in 101us (2445us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790778872.109113:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778872.109161:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790778872.109168:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000280c38c5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790778872.109172:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790778872.109175:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ec818fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663651328:0@lo:38: 00000100:00100000:2.0:1790778872.109964:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663651456 00000100:00100000:2.0:1790778872.109971:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663651456 00000100:00100000:2.0:1790778872.110009:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790778872.110016:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003ef7629c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:6550:x1877767663651456:12345-0@lo:502: 00000100:00100000:2.0:1790778872.110155:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003ef7629c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:6550:x1877767663651456:12345-0@lo:502: Request processed in 140us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778872.110169:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790778872.110367:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edd7a0e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:6550:1877767663651456:0@lo:502: 00000040:00080000:0.0:1790778872.110403:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1790778872.110650:0:6500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1790778872.110672:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790778872.110692:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778872.110703:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790778872.110857:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790778872.110860:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790778872.110862:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778872.110863:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790778872.110864:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778872.110866:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778872.110867:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790778872.110869:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790778872.110870:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790778872.110872:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790778872.110874:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778872.110875:0:6500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790778872.110954:0:6500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1790778872.110957:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790778872.110959:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790778872.110960:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778872.110961:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790778872.110962:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778872.110963:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778872.110965:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790778872.110966:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790778872.110967:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790778872.110968:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790778872.110969:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778872.110970:0:6500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790778872.110989:0:6500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790778872.111003:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ec818fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663651584:0@lo:253: 00000100:00100000:2.0:1790778872.111051:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778872.115669:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038573b3d going to sleep for 11 seconds 00000100:00100000:0.0:1790778872.118397:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663651584 00000100:00100000:0.0:1790778872.118412:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663651584 00000100:00100000:0.0:1790778872.118482:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790778872.118492:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000005b983fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:6500:x1877767663651584:12345-0@lo:253: 20000000:01000000:0.0:1790778872.118528:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790778872.118541:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790778872.126096:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790778872.126122:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790778872.126250:0:6539:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790778872.126256:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790778872.126274:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778872.126295:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001cb04060/0xb1aa4014e936c70a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c703 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778872.126304:0:6539:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778872.126343:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001cb04060/0xb1aa4014e936c70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c703 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778872.126358:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001cb04060/0xb1aa4014e936c70a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c703 expref: 12 pid: 6515 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778872.126372:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076d3f023 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663651712:0@lo:104: 00000100:00100000:2.0:1790778872.126435:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778872.126487:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb366355 going to sleep for 11 seconds 00000100:00100000:0.0:1790778872.126689:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663651712 00000100:00100000:0.0:1790778872.126697:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663651712 00000100:00100000:2.0:1790778872.126849:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000005b983fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:6500:x1877767663651584:12345-0@lo:253: Request processed in 8359us (15798us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778872.126860:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790778872.126996:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ec818fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:6500:1877767663651584:0@lo:253: 10000000:01000000:3.0:1790778872.127007:0:6500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790778872.127010:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790778872.127012:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790778872.127013:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790778872.127014:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790778872.127016:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790778872.127017:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790778872.127018:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790778872.127020:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790778872.127021:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790778872.127022:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790778872.127024:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790778872.127025:0:6500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790778872.127037:0:6500:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1790778872.131056:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778872.131078:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000065d9dcc4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:6539:x1877767663651712:12345-0@lo:104: 00010000:00010000:0.0:1790778872.131098:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.131204:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790778872.131209:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000065d9dcc4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:6539:x1877767663651712:12345-0@lo:104: Request processed in 144us (4776us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778872.131217:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778872.131286:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076d3f023 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663651712:0@lo:104: 00010000:00010000:0.0:1790778872.131312:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.134573:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778872.134590:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.134603:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e2fc13a8 already unused, calling callback (000000007093b7d7) 10000000:00010000:0.0:1790778872.134623:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.134633:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778872.134639:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778872.134644:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778872.134706:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.134713:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778872.134873:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.134905:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000e2fc13a8/0xb1aa4014e936c703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c70a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.134927:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778872.134929:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778872.134931:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778872.135026:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778872.135043:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edd7a0e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663651840:0@lo:103: 00000100:00100000:2.0:1790778872.135104:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778872.135593:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663651840 00000100:00100000:0.0:1790778872.135603:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663651840 00010000:00010000:0.0:1790778872.135630:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001cb04060/0xb1aa4014e936c70a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c703 expref: 12 pid: 6515 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778872.135670:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778872.135679:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000aa589b3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+12:3649:x1877767663651840:12345-0@lo:103: 00010000:00010000:0.0:1790778872.135692:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778872.135702:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001cb04060/0xb1aa4014e936c70a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c703 expref: 12 pid: 6515 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.135713:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001cb04060/0xb1aa4014e936c70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c703 expref: 12 pid: 6515 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.136363:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001cb04060/0xb1aa4014e936c70a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c703 expref: 12 pid: 6515 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.136381:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.136389:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790778872.136405:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010150298s 00010000:00010000:0.0:1790778872.136409:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.136415:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.136421:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.136427:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.136433:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000011deb53c already unused, calling callback (0000000053eea93d) 00010000:00010000:0.0:1790778872.136436:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.136443:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.136475:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778872.136486:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778872.136546:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000aa589b3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+11:3649:x1877767663651840:12345-0@lo:103: Request processed in 868us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778872.136554:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778872.136606:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edd7a0e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663651840:0@lo:103: 00010000:00010000:2.0:1790778872.136688:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778872.136706:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778872.136712:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c73b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1790778872.151601:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1790778872.152436:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1790778872.152658:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1790778872.153515:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1790778872.154871:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1790778872.156338:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1790778872.165351:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1790778872.167171:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1790778872.168180:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1790778872.168518:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1790778872.169022:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1790778872.169181:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1790778872.178048:0:6500:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1790778872.193551:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1790778872.193763:0:6555:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1790778872.193768:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790778872.193925:0:6556:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1790778872.196638:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790778872.196743:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790778872.197311:0:6500:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790778872.197319:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790778872.197494:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790778872.198646:0:6500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790778872.201085:0:6500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790778872.201164:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790778872.201419:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790778872.201618:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1790778872.202303:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1790778872.202439:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1790778872.202602:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1790778872.202741:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1790778872.202902:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1790778872.203027:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1790778872.203151:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1790778872.203260:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1790778872.203395:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1790778872.203533:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1790778872.203706:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1790778872.205052:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1790778872.205206:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1790778872.205501:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1790778872.205634:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1790778872.205821:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1790778872.206191:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1790778872.206471:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1790778872.206598:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1790778872.206831:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1790778872.207154:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1790778872.207477:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1790778872.207589:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1790778872.207800:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000040:00080000:1.0:1790778872.208028:0:6556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1790778872.208226:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1790778872.211198:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1790778872.211505:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1790778872.211624:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1790778872.211813:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1790778872.212073:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1790778872.212183:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1790778872.212528:0:6500:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1790778872.212706:0:6500:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1790778872.216056:0:6556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790778872.216146:0:6556:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790778872.216150:0:6556:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1790778872.220182:0:6500:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790778872.220229:0:6500:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc92c1c77988 00100000:10000000:0.0:1790778872.220238:0:6500:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790778872.222865:0:6500:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790778872.222908:0:6500:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790778872.222927:0:6500:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790778872.222952:0:6500:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1790778872.223843:0:6500:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790778872.224077:0:6500:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1790778872.744026:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778873.767984:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778874.799501:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778875.816951:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790778876.231454:0:6801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790778876.848590:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790778877.333326:0:6853:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790778877.333538:0:6853:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1790778877.546068:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790778877.546085:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790778877.546088:0:37:0:(import.c:65:import_set_state_nolock()) 00000000280c38c5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790778877.546108:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000280c38c5 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790778877.546135:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007467f5a4 x1877767663652096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790778877.546172:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007467f5a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663652096:0@lo:38: 00000100:00100000:1.0:1790778877.546248:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778877.546404:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000675c728c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663651968:0@lo:400: 00000100:00100000:0.0:1790778877.546439:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778877.546519:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663652096 00000100:00100000:0.0:1790778877.546527:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663652096 00000100:00100000:0.0:1790778877.546558:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778877.546565:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d0fb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663652096:12345-0@lo:38: 00010000:00080000:0.0:1790778877.546587:0:6525:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1790778877.546622:0:6525:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb1aa4014e936c742 00000100:00100000:1.0:1790778877.546820:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663651968 00000100:00100000:1.0:1790778877.546825:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663651968 00000100:00100000:1.0:1790778877.546859:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790778877.546865:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b41f518d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+11:3651:x1877767663651968:12345-0@lo:400: 00000100:00100000:1.0:1790778877.546933:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b41f518d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+11:3651:x1877767663651968:12345-0@lo:400: Request processed in 68us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778877.546940:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00100000:0.0:1790778877.547415:0:6525:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790778877.547561:0:6525:0:(import.c:65:import_set_state_nolock()) 00000000b032ed37 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790778877.548802:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d0fb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877767663652096:12345-0@lo:38: Request processed in 2232us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778877.548813:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778877.548867:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000675c728c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663651968:0@lo:400: 00010000:00080000:1.0:1790778877.555911:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007467f5a4 x1877767663652096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790778887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790778877.555937:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790778877.555945:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790778877.555950:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790778877.555953:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000280c38c5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790778877.555960:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007467f5a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663652096:0@lo:38: 00010000:00010000:0.0:1790778877.864002:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778878.888130:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778879.915850:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790778880.602308:0:6954:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790778880.602479:0:6954:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790778880.936079:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790778881.128752:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790778881.128761:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b77208a9000 from 3 10000000:01000000:2.0:1790778881.128765:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790778881.128810:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778881.128821:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778881.128832:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778881.128855:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017b8d892 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663652224:0@lo:101: 00000100:00100000:2.0:1790778881.128950:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778881.129018:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000483d427c going to sleep for 11 seconds 00000100:00100000:0.0:1790778881.132557:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663652224 00000100:00100000:0.0:1790778881.132571:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663652224 00000100:00100000:0.0:1790778881.132643:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790778881.132651:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c9574b2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+11:6520:x1877767663652224:12345-0@lo:101: 00010000:00010000:0.0:1790778881.132666:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778881.132706:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e2fc13a8/0xb1aa4014e936c750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c749 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778881.132732:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e2fc13a8/0xb1aa4014e936c750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c749 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778881.132744:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e2fc13a8/0xb1aa4014e936c750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c749 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778881.132752:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e2fc13a8, rc 0) 00000100:00100000:0.0:1790778881.132835:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c9574b2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:6520:x1877767663652224:12345-0@lo:101: Request processed in 185us (3885us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778881.132842:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790778881.133194:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017b8d892 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663652224:0@lo:101: 00010000:00010000:2.0:1790778881.133211:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778881.133219:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778881.133291:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017b8d892 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663652352:0@lo:256: 00000100:00100000:2.0:1790778881.133512:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778881.133563:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000483d427c going to sleep for 11 seconds 00000100:00100000:3.0:1790778881.133812:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663652352 00000100:00100000:3.0:1790778881.133818:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663652352 00000100:00100000:3.0:1790778881.133858:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790778881.133865:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001ae99071 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:6520:x1877767663652352:12345-0@lo:256: 20000000:01000000:3.0:1790778881.133913:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790778881.133928:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790778881.133931:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1790778881.134017:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001ae99071 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:6520:x1877767663652352:12345-0@lo:256: Request processed in 153us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778881.134024:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790778881.134224:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017b8d892 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663652352:0@lo:256: 10000000:01000000:0.0:1790778881.134263:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790778881.134269:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778881.134278:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778881.961353:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778882.671592:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000919ccec3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663652480:0@lo:400: 00000100:00100000:0.0:1790778882.671661:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778882.673059:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663652480 00000100:00100000:1.0:1790778882.673070:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663652480 00000100:00100000:1.0:1790778882.673120:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790778882.673129:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004e7bb879 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:3652:x1877767663652480:12345-0@lo:400: 00000100:00100000:2.0:1790778882.674174:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb7765a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663652608:0@lo:400: 00000100:00100000:2.0:1790778882.674221:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778882.674288:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663652608 00000100:00100000:2.0:1790778882.674293:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663652608 00000100:00100000:2.0:1790778882.674325:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778882.674332:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005367dfa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663652608:12345-0@lo:400: 00000100:00100000:2.0:1790778882.674372:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005367dfa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663652608:12345-0@lo:400: Request processed in 40us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778882.674380:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790778882.674417:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fb7765a9 x1877767663652608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778882.674430:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb7765a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663652608:0@lo:400: 00000100:00100000:1.0:1790778882.675457:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004e7bb879 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:3652:x1877767663652480:12345-0@lo:400: Request processed in 2327us (3793us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778882.675468:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790778882.682705:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000919ccec3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663652480:0@lo:400: 00010000:00010000:3.0:1790778882.992318:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778884.032094:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778885.039518:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778886.056088:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778887.087149:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778887.784733:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778887.784752:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007467f5a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663652736:0@lo:400: 00000100:00100000:1.0:1790778887.784752:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bea34a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663652864:0@lo:400: 00000100:00100000:3.0:1790778887.784858:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778887.785026:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663652736 00000100:00100000:2.0:1790778887.785034:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663652736 00000100:00100000:2.0:1790778887.785080:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790778887.785087:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007f527064 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+12:3649:x1877767663652736:12345-0@lo:400: 00000100:00100000:2.0:1790778887.785136:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007f527064 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+12:3649:x1877767663652736:12345-0@lo:400: Request processed in 50us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778887.785142:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790778887.785214:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007467f5a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663652736:0@lo:400: 00000100:00100000:1.0:1790778887.790391:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778887.790508:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663652864 00000100:00100000:0.0:1790778887.790524:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663652864 00000100:00100000:0.0:1790778887.790582:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778887.790590:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000033d7b023 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663652864:12345-0@lo:400: 00000100:00100000:0.0:1790778887.790656:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000033d7b023 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663652864:12345-0@lo:400: Request processed in 66us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778887.790663:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790778887.790787:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007bea34a6 x1877767663652864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778887.790801:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bea34a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663652864:0@lo:400: 00010000:00010000:1.0:1790778888.107808:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778889.129740:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778890.169676:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778891.176657:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790778892.070537:0:7453:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790778892.070542:0:7453:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1790778892.070544:0:7453:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1790778892.070761:0:7453:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006f2ca15e 00000020:01000004:1.0:1790778892.070778:0:7453:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1790778892.070788:0:7453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790778892.070802:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000983cc0bd) 00000020:00000080:1.0:1790778892.070817:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790778892.133806:0:7453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1790778892.133874:0:7453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1790778892.175726:0:7453:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790778892.176226:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1790778892.176238:0:7453:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790778892.176250:0:7453:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936c75e 00000020:01000004:2.0:1790778892.176257:0:7453:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1790778892.176278:0:7453:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790778892.176280:0:7453:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790778892.176286:0:7453:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1790778892.176312:0:7453:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1790778892.176316:0:7453:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00010000:00010000:0.0:1790778892.207683:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790778892.228366:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790778892.228402:0:7453:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1790778892.228406:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790778892.228408:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790778892.228409:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778892.228410:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790778892.228411:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778892.228413:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778892.228414:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790778892.228415:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790778892.228416:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790778892.228418:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778892.228419:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790778892.228422:0:7453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1790778892.228424:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790778892.228425:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790778892.228426:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778892.228427:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790778892.228428:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778892.228428:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778892.228429:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790778892.228430:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790778892.228431:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790778892.228432:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778892.228433:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790778892.228456:0:7453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790778892.228470:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edd7a0e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663652992:0@lo:253: 00000100:00100000:0.0:1790778892.228542:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.228593:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4628b3f going to sleep for 11 seconds 00000100:00100000:2.0:1790778892.229694:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663652992 00000100:00100000:2.0:1790778892.229713:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663652992 00000100:00100000:2.0:1790778892.229787:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790778892.229795:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009d8de556 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:7453:x1877767663652992:12345-0@lo:253: 20000000:01000000:2.0:1790778892.229830:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790778892.229835:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1790778892.229839:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1790778892.229842:0:6515:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1790778892.229897:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1790778892.230101:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790778892.230296:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1790778892.230309:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790778892.230328:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1790778892.230346:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1790778892.230359:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1790778892.230411:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1790778892.230419:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1790778892.230432:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1790778892.230438:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1790778892.230449:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1790778892.230454:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1790778892.230465:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1790778892.230479:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1790778892.230725:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1790778892.230735:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:2.0:1790778892.232045:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1790778892.232062:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790778892.232089:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1790778892.232097:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:2.0:1790778892.232111:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1790778892.232118:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1790778892.232132:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1790778892.232163:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1790778892.232178:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1790778892.232268:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1790778892.232276:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1790778892.232286:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1790778892.232299:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1790778892.232312:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1790778892.232317:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1790778892.232328:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1790778892.232345:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1790778892.232351:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1790778892.232372:0:6515:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1790778892.232379:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1790778892.242525:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1790778892.243122:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1790778892.243151:0:6515:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.103@tcp for mdt 20000000:01000000:1.0:1790778892.243154:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:1.0:1790778892.243182:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1790778892.243189:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1790778892.243203:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1790778892.243209:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:1.0:1790778892.243226:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1790778892.243235:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1790778892.243248:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1790778892.243285:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1790778892.243340:0:6515:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1790778892.243351:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1790778892.245587:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1790778892.245850:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1790778892.245912:0:6515:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.103@tcp for mdt 20000000:01000000:2.0:1790778892.245914:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:2.0:1790778892.245944:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1790778892.245953:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790778892.245969:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1790778892.245975:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:2.0:1790778892.245988:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1790778892.245996:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1790778892.246022:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1790778892.246055:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1790778892.246082:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790778892.246085:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790778892.246089:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790778892.246135:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1790778892.246138:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790778892.248530:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1790778892.248585:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1790778892.248612:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1790778892.248838:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1790778892.248861:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1790778892.248907:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1790778892.248924:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790778892.248927:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790778892.254773:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1790778892.254843:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1790778892.254860:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1790778892.255369:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1790778892.255392:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1790778892.255413:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1790778892.255424:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790778892.255426:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790778892.255934:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1790778892.255955:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1790778892.255967:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1790778892.256319:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1790778892.256341:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1790778892.256356:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1790778892.256369:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790778892.256371:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790778892.256376:0:6515:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1790778892.256382:0:6515:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1790778892.258260:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1790778892.258443:0:6515:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790778892.289375:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790778892.289482:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.289510:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000016f6694c/0xb1aa4014e936c69a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c693 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.289527:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e3804652/0xb1aa4014e936c6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c6af expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.289533:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d400971d/0xb1aa4014e936c726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c71f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.289539:0:6515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.289582:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d400971d/0xb1aa4014e936c726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c71f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.289606:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d400971d/0xb1aa4014e936c726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c71f expref: 12 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778892.289638:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a73be46c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1877767663653120:0@lo:104: 00000100:00100000:3.0:1790778892.289702:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790778892.289771:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e3804652/0xb1aa4014e936c6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c6af expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.289779:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e3804652/0xb1aa4014e936c6b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c6af expref: 12 pid: 6517 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778892.289788:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e54d1525 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1877767663653248:0@lo:104: 00000100:00100000:3.0:1790778892.289809:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790778892.289844:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000016f6694c/0xb1aa4014e936c69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c693 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.289852:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000016f6694c/0xb1aa4014e936c69a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c693 expref: 12 pid: 6517 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778892.289859:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001628d064 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1877767663653376:0@lo:104: 00000100:00100000:3.0:1790778892.289956:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778892.289967:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb07108a going to sleep for 11 seconds 00000100:00100000:0.0:1790778892.290192:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663653120 00000100:00100000:0.0:1790778892.290201:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663653120 00000100:00100000:0.0:1790778892.290235:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663653248 00000100:00100000:0.0:1790778892.290238:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663653248 00000100:00100000:0.0:1790778892.290247:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663653376 00000100:00100000:0.0:1790778892.290249:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663653376 00000100:00100000:0.0:1790778892.290261:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778892.290269:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000017a1e33b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+5:6515:x1877767663653120:12345-0@lo:104: 00010000:00010000:0.0:1790778892.290281:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290352:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790778892.290357:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000017a1e33b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+5:6515:x1877767663653120:12345-0@lo:104: Request processed in 90us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.290364:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778892.290383:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790778892.290388:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c4646585 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6515:x1877767663653248:12345-0@lo:104: 00010000:00010000:0.0:1790778892.290395:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290427:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790778892.290432:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c4646585 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6515:x1877767663653248:12345-0@lo:104: Request processed in 45us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.290437:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790778892.290450:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790778892.290454:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005a2ed2fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6515:x1877767663653376:12345-0@lo:104: 00010000:00010000:0.0:1790778892.290469:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290494:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790778892.290498:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005a2ed2fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6515:x1877767663653376:12345-0@lo:104: Request processed in 45us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.290504:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790778892.290532:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790778892.290538:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290545:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c09bb72b already unused, calling callback (000000007093b7d7) 10000000:00010000:0.0:1790778892.290549:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290556:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778892.290562:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778892.290568:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778892.290594:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290612:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778892.290627:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290633:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000c09bb72b/0xb1aa4014e936c71f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c726 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290652:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790778892.290655:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290660:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000043f078fb already unused, calling callback (000000007093b7d7) 10000000:00010000:0.0:1790778892.290662:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290668:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778892.290673:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778892.290678:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778892.290690:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290696:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778892.290710:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290715:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 0000000043f078fb/0xb1aa4014e936c6af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c6b6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290724:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778892.290726:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290739:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f475edfe already unused, calling callback (000000007093b7d7) 10000000:00010000:0.0:1790778892.290742:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290747:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778892.290753:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778892.290758:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778892.290770:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290776:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778892.290780:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290786:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000f475edfe/0xb1aa4014e936c693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c69a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.290799:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778892.290801:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778892.290802:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778892.290814:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f0362a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663653504:0@lo:103: 00000100:00100000:0.0:1790778892.290844:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.290874:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003893ad44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663653632:0@lo:103: 00000100:00100000:0.0:1790778892.290939:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790778892.290959:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778892.290980:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778892.290988:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005356fbfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663653760:0@lo:103: 00000100:00100000:0.0:1790778892.291243:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.291294:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663653504 00000100:00100000:0.0:1790778892.291300:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663653504 00000100:00100000:2.0:1790778892.291313:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663653632 00010000:00010000:0.0:1790778892.291323:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d400971d/0xb1aa4014e936c726 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c71f expref: 13 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778892.291324:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663653632 00000100:00100000:0.0:1790778892.291348:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663653760 00000100:00100000:0.0:1790778892.291353:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663653760 00010000:00010000:2.0:1790778892.291365:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e3804652/0xb1aa4014e936c6b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c6af expref: 15 pid: 6517 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.291374:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000016f6694c/0xb1aa4014e936c69a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c693 expref: 15 pid: 6517 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778892.291423:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790778892.291433:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000403084a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+15:3652:x1877767663653504:12345-0@lo:103: 00010000:00010000:2.0:1790778892.291450:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778892.291456:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d400971d/0xb1aa4014e936c726 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c71f expref: 15 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.291471:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d400971d/0xb1aa4014e936c726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c71f expref: 15 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.291494:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778892.291534:0:6509:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790778892.291545:0:6509:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1790778892.292358:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000403084a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+15:3652:x1877767663653504:12345-0@lo:103: Request processed in 922us (1509us total) trans 0 rc 0/0 00010000:00010000:3.0:1790778892.292476:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d400971d/0xb1aa4014e936c726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c71f expref: 15 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778892.292491:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a73be46c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1877767663653120:0@lo:104: 00000100:00100000:3.0:1790778892.292501:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e54d1525 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1877767663653248:0@lo:104: 00000100:00100000:3.0:1790778892.292508:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001628d064 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1877767663653376:0@lo:104: 00010000:00010000:3.0:1790778892.292544:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778892.294646:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f0362a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663653504:0@lo:103: 00000100:00100000:0.0:1790778892.295748:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790778892.295770:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005217bd19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+14:3649:x1877767663653632:12345-0@lo:103: 00010000:00010000:0.0:1790778892.295790:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778892.295798:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e3804652/0xb1aa4014e936c6b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c6af expref: 14 pid: 6517 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.295815:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e3804652/0xb1aa4014e936c6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c6af expref: 14 pid: 6517 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.295832:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3804652/0xb1aa4014e936c6b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c6af expref: 14 pid: 6517 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.295848:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778892.295954:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005217bd19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+13:3649:x1877767663653632:12345-0@lo:103: Request processed in 197us (5017us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.295963:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790778892.295990:0:6508:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790778892.296001:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790778892.296033:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a068deef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+12:3649:x1877767663653760:12345-0@lo:103: 00010000:00010000:0.0:1790778892.296042:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778892.296046:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000016f6694c/0xb1aa4014e936c69a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c693 expref: 12 pid: 6517 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296053:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000016f6694c/0xb1aa4014e936c69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c693 expref: 12 pid: 6517 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296063:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000016f6694c/0xb1aa4014e936c69a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c693 expref: 12 pid: 6517 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296073:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296080:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296093:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296099:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296105:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296111:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296116:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003915a468 already unused, calling callback (0000000053eea93d) 00010000:00010000:0.0:1790778892.296119:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296134:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296145:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.296169:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778892.296194:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a068deef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+11:3649:x1877767663653760:12345-0@lo:103: Request processed in 163us (4952us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.296201:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790778892.296239:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005356fbfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663653760:0@lo:103: 00000100:00100000:0.0:1790778892.296248:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003893ad44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663653632:0@lo:103: 00010000:00010000:3.0:1790778892.297189:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.297203:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.297209:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003915a468/0xb1aa4014e936c765 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790778892.297228:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1790778892.305009:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009d8de556 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+10:7453:x1877767663652992:12345-0@lo:253: Request processed in 75207us (76460us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778892.305026:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790778892.305220:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edd7a0e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663652992:0@lo:253: 10000000:01000000:0.0:1790778892.305236:0:7453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790778892.305239:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790778892.305242:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790778892.305243:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778892.305244:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1790778892.305246:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778892.305247:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778892.305248:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790778892.305250:0:7453:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790778892.305252:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778892.305253:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790778892.305273:0:7453:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006f2ca15e from lustre-MDT0001 10000000:01000000:0.0:1790778892.305304:0:7453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1790778892.305307:0:7453:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790778892.305314:0:7453:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b773059cd40 local copy 10000000:01000000:0.0:1790778892.305318:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790778892.305353:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.305376:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.305386:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778892.305404:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edd7a0e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663653888:0@lo:101: 00000100:00100000:0.0:1790778892.305440:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.305484:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000008aba6d35 going to sleep for 11 seconds 00000100:00100000:3.0:1790778892.305674:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663653888 00000100:00100000:3.0:1790778892.305682:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663653888 00000100:00100000:3.0:1790778892.305734:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790778892.305742:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005177f4da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+10:7453:x1877767663653888:12345-0@lo:101: 00010000:00010000:3.0:1790778892.305755:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778892.305768:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004fe18cbe/0xb1aa4014e936c773 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c76c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.305789:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004fe18cbe/0xb1aa4014e936c773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c76c expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.305800:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004fe18cbe/0xb1aa4014e936c773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c76c expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.305820:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004fe18cbe, rc 0) 00000100:00100000:3.0:1790778892.305861:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005177f4da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+11:7453:x1877767663653888:12345-0@lo:101: Request processed in 120us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778892.305867:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790778892.306515:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edd7a0e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663653888:0@lo:101: 00010000:00010000:1.0:1790778892.306549:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.306571:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778892.306765:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bea34a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654016:0@lo:501: 00000100:00100000:1.0:1790778892.306830:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.306867:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000025506b8 going to sleep for 11 seconds 00000100:00100000:3.0:1790778892.307094:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663654016 00000100:00100000:3.0:1790778892.307114:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663654016 00000100:00100000:3.0:1790778892.307168:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790778892.307176:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008ffc94e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+11:7453:x1877767663654016:12345-0@lo:501: 00000100:00100000:3.0:1790778892.307286:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008ffc94e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+11:7453:x1877767663654016:12345-0@lo:501: Request processed in 112us (457us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790778892.307294:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790778892.307390:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790778892.308838:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bea34a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654016:0@lo:501: 10000000:01000000:1.0:1790778892.308873:0:7453:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790778892.308940:0:7453:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790778892.308950:0:7453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.308961:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.308969:0:7453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.308991:0:7453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790778892.309030:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b7712708000 10000000:01000000:1.0:1790778892.309051:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790778892.309056:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b773059cd40 10000000:01000000:1.0:1790778892.309059:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790778892.309062:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b773059cd40 from 1 10000000:01000000:1.0:1790778892.309066:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790778892.309184:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778892.309196:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.309209:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000099048d already unused, calling callback (000000007093b7d7) 10000000:00010000:0.0:1790778892.309213:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.309222:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778892.309230:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778892.309236:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778892.309274:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.309281:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778892.309309:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.309329:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 000000000099048d/0xb1aa4014e936c76c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1aa4014e936c773 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778892.309489:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003893ad44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663654272:0@lo:103: 00000100:00100000:2.0:1790778892.309560:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778892.310751:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000000dbf8d30/0xb1aa4014e936c77a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.310774:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000000dbf8d30/0xb1aa4014e936c77a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.310787:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000000dbf8d30/0xb1aa4014e936c77a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778892.310815:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bea34a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654144:0@lo:101: 00000100:00100000:1.0:1790778892.310919:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.310958:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0e8167b going to sleep for 11 seconds 00000100:00100000:2.0:1790778892.312244:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663654144 00000100:00100000:2.0:1790778892.312259:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663654144 00000100:00100000:2.0:1790778892.312322:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790778892.312331:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001f579fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+10:7453:x1877767663654144:12345-0@lo:101: 00010000:00010000:2.0:1790778892.312350:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778892.312370:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c781 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c77a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.312397:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c781 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c77a expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.312408:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011deb53c/0xb1aa4014e936c781 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c77a expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.312416:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011deb53c, rc 0) 00000100:00100000:2.0:1790778892.312500:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001f579fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+11:7453:x1877767663654144:12345-0@lo:101: Request processed in 170us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.312507:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790778892.313932:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bea34a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654144:0@lo:101: 00010000:00010000:1.0:1790778892.313972:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000000dbf8d30/0xb1aa4014e936c77a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c781 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.313986:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000000dbf8d30/0xb1aa4014e936c77a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c781 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778892.314020:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790778892.314042:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000000dbf8d30/0xb1aa4014e936c77a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c781 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.314049:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000000dbf8d30/0xb1aa4014e936c77a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c781 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778892.314095:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b7712708000 10000000:01000000:1.0:1790778892.316934:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790778892.316946:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b7712708000 from 1 10000000:01000000:1.0:1790778892.316951:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790778892.317016:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000943cb1f3/0xb1aa4014e936c788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.317031:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000943cb1f3/0xb1aa4014e936c788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.317044:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000943cb1f3/0xb1aa4014e936c788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778892.317072:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bea34a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654400:0@lo:101: 00010000:00010000:0.0:1790778892.317283:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778892.317290:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778892.317292:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778892.317316:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663654272 00000100:00100000:0.0:1790778892.317328:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663654272 00000100:00100000:0.0:1790778892.317393:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778892.317403:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fb7765a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+11:3651:x1877767663654272:12345-0@lo:103: 00010000:00010000:0.0:1790778892.317419:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778892.317434:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004fe18cbe/0xb1aa4014e936c773 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936c76c expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.317453:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778892.326912:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fb7765a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+10:3651:x1877767663654272:12345-0@lo:103: Request processed in 9504us (17345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.326937:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778892.327080:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003893ad44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663654272:0@lo:103: 00000100:00100000:1.0:1790778892.332834:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.333490:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663654400 00000100:00100000:0.0:1790778892.333505:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663654400 00000100:00100000:0.0:1790778892.333579:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790778892.333588:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fbe09715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+10:7453:x1877767663654400:12345-0@lo:101: 00010000:00010000:0.0:1790778892.333615:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778892.333631:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fba9dde3/0xb1aa4014e936c78f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c788 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.333658:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fba9dde3/0xb1aa4014e936c78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c788 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.333681:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fba9dde3/0xb1aa4014e936c78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c788 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.333690:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fba9dde3, rc 0) 00000100:00100000:0.0:1790778892.333756:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fbe09715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+11:7453:x1877767663654400:12345-0@lo:101: Request processed in 170us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.333762:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790778892.333818:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0e8167b going to sleep for 11 seconds 00000100:00100000:0.0:1790778892.333843:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bea34a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654400:0@lo:101: 00010000:00010000:0.0:1790778892.333858:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000943cb1f3/0xb1aa4014e936c788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.333867:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000943cb1f3/0xb1aa4014e936c788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778892.333914:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790778892.333937:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000943cb1f3/0xb1aa4014e936c788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.333944:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000943cb1f3/0xb1aa4014e936c788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778892.333952:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790778892.333958:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790778892.333964:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b7712708000 10000000:01000000:0.0:1790778892.333968:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790778892.333974:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1790778892.333977:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1790778892.334010:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000006112a5fc/0xb1aa4014e936c796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.334018:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000006112a5fc/0xb1aa4014e936c796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.334026:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000006112a5fc/0xb1aa4014e936c796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778892.334043:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005356fbfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654528:0@lo:101: 00000100:00100000:0.0:1790778892.334074:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.334099:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000006d7f73aa going to sleep for 11 seconds 00000100:00100000:3.0:1790778892.334282:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663654528 00000100:00100000:3.0:1790778892.334287:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663654528 00000100:00100000:3.0:1790778892.334325:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790778892.334332:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009f9ecc9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+11:7453:x1877767663654528:12345-0@lo:101: 00010000:00010000:3.0:1790778892.334339:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778892.334347:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003915a468/0xb1aa4014e936c79d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c796 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.334361:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003915a468/0xb1aa4014e936c79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c796 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.334369:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003915a468/0xb1aa4014e936c79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c796 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.334376:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003915a468, rc 0) 00000100:00100000:3.0:1790778892.334413:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009f9ecc9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:7453:x1877767663654528:12345-0@lo:101: Request processed in 83us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778892.334427:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790778892.334491:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005356fbfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654528:0@lo:101: 00010000:00010000:1.0:1790778892.334526:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000006112a5fc/0xb1aa4014e936c796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.334538:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000006112a5fc/0xb1aa4014e936c796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778892.334708:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a24eceb pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654656:0@lo:501: 00000100:00100000:1.0:1790778892.334765:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.334803:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000103a1eb1 going to sleep for 11 seconds 00000100:00100000:3.0:1790778892.335263:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663654656 00000100:00100000:3.0:1790778892.335271:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663654656 00000100:00100000:3.0:1790778892.335306:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790778892.335312:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cd1e94f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:7453:x1877767663654656:12345-0@lo:501: 00000100:00100000:3.0:1790778892.335434:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cd1e94f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:7453:x1877767663654656:12345-0@lo:501: Request processed in 122us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778892.335441:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790778892.336765:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a24eceb pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654656:0@lo:501: 00000100:00100000:1.0:1790778892.336842:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a24eceb pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654784:0@lo:503: 00000100:00100000:1.0:1790778892.336969:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.337121:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000103a1eb1 going to sleep for 11 seconds 00000100:00100000:3.0:1790778892.350522:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663654784 00000100:00100000:3.0:1790778892.350546:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663654784 00000100:00100000:2.0:1790778892.350855:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790778892.350925:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000be09f2b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:7453:x1877767663654784:12345-0@lo:503: 00000100:00100000:2.0:1790778892.351096:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000be09f2b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:7453:x1877767663654784:12345-0@lo:503: Request processed in 229us (14126us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.351104:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790778892.354568:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a24eceb pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654784:0@lo:503: 00000040:00080000:0.0:1790778892.355322:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790778892.355425:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006513f55d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654912:0@lo:502: 00000100:00100000:0.0:1790778892.355511:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.355693:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e87f316 going to sleep for 11 seconds 00000100:00100000:3.0:1790778892.356146:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663654912 00000100:00100000:3.0:1790778892.356154:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663654912 00000100:00100000:3.0:1790778892.356300:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790778892.356308:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000992f1076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:7453:x1877767663654912:12345-0@lo:502: 00000100:00100000:3.0:1790778892.356442:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000992f1076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+12:7453:x1877767663654912:12345-0@lo:502: Request processed in 134us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778892.356449:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790778892.356541:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006513f55d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663654912:0@lo:502: 00000040:00080000:0.0:1790778892.356782:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790778892.356810:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1790778892.356825:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1790778892.356839:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1790778892.356852:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1790778892.356864:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1790778892.356910:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1790778892.357271:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1790778892.357291:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1790778892.357319:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1790778892.357333:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1790778892.357347:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1790778892.357359:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1790778892.357382:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1790778892.357395:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1790778892.357408:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1790778892.357420:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1790778892.357433:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1790778892.357446:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1790778892.357459:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1790778892.357471:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1790778892.357484:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1790778892.357496:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1790778892.357533:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006513f55d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655040:0@lo:502: 00000100:00100000:0.0:1790778892.357576:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.362470:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e87f316 going to sleep for 11 seconds 00000100:00100000:2.0:1790778892.364278:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663655040 00000100:00100000:2.0:1790778892.364312:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663655040 00000100:00100000:2.0:1790778892.364369:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790778892.364378:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004f79fd5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:7453:x1877767663655040:12345-0@lo:502: 00000100:00100000:2.0:1790778892.364562:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004f79fd5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:7453:x1877767663655040:12345-0@lo:502: Request processed in 185us (6985us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.364570:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790778892.364783:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006513f55d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655040:0@lo:502: 00000040:00080000:0.0:1790778892.364868:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1790778892.364938:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1790778892.365748:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778892.365760:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778892.365762:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790778892.365767:0:7466:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1790778892.365770:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790778892.365782:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000077bce194) 00000020:00000080:0.0:1790778892.365802:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1790778892.365807:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790778892.366041:0:7466:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790778892.366049:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936c7ab 00000020:00000080:0.0:1790778892.366330:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1790778892.366335:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778892.366338:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778892.366340:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790778892.366342:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778892.366350:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778892.366352:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1790778892.366355:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790778892.366362:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000009cbaaab6) 00000020:00000080:0.0:1790778892.366374:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1790778892.366378:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790778892.366379:0:7466:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1790778892.366382:0:7466:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1790778892.366388:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790778892.366432:0:7466:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006f2ca15e from lustre-MDT0001, refs=2 00000020:00000080:0.0:1790778892.366443:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000008bdc24ed) 00000020:00000080:0.0:1790778892.366452:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1790778892.366588:0:7466:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790778892.366604:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936c7c0 00000020:00000080:0.0:1790778892.366709:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1790778892.366716:0:7466:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790778892.366720:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb1aa4014e936c7c7 00080000:01000000:0.0:1790778892.366727:0:7466:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790778892.366730:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936c7ce 00080000:10000000:0.0:1790778892.369066:0:7466:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1790778892.369288:0:7466:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1790778892.538974:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1790778892.539218:0:7466:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1790778892.544027:0:7466:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1790778892.544515:0:7466:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790778892.571703:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1790778892.571725:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778892.571734:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778892.571736:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1790778892.571741:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778892.571748:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778892.571750:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1790778892.571753:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790778892.571760:0:7466:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:0.0:1790778892.573256:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790778892.573294:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000246e83df) 00000020:00000080:0.0:1790778892.573326:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1790778892.573341:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790778892.573465:0:7466:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1790778892.573473:0:7466:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790778892.573481:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936c7dc 00010000:00080000:0.0:1790778892.573522:0:7466:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000060a7a8bc@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1790778892.575292:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1790778892.578899:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790778892.578919:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790778892.578970:0:7466:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790778892.578994:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936c7e3 00000100:00080000:1.0:1790778892.579007:0:7466:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790778892.579020:0:7466:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000060a7a8bc using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790778892.579064:0:7466:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006a24eceb x1877767663655168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790778892.579090:0:7466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1790778892.579398:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778892.579403:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778892.579405:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1790778892.579408:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790778892.579412:0:7466:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1790778892.579413:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790778892.579415:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790778892.579416:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790778892.579419:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778892.579420:0:7466:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790778892.579423:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778892.579428:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778892.579429:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1790778892.579433:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790778892.579472:0:7466:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790778892.579486:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778892.579489:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778892.579491:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1790778892.579501:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778892.579503:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778892.579505:0:7466:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790778892.579507:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790778892.579509:0:7466:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790778892.579543:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778892.579545:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778892.579547:0:7466:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790778892.579550:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1790778892.579749:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1790778892.579841:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1790778892.579857:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000006112a5fc/0xb1aa4014e936c796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.579870:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000006112a5fc/0xb1aa4014e936c796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778892.579911:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7712708000 from 1 10000000:01000000:1.0:1790778892.579915:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790778892.579944:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.579952:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.579964:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778892.579982:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cacfd31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655424:0@lo:101: 00000100:00100000:1.0:1790778892.580057:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778892.580278:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a24eceb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663655168:0@lo:38: 00000100:00100000:3.0:1790778892.580324:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778892.580387:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000491b6447 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663655296:0@lo:400: 00000100:00100000:3.0:1790778892.580417:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.580626:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014c6dd5d going to sleep for 11 seconds 00000100:00100000:2.0:1790778892.580754:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663655424 00000100:00100000:2.0:1790778892.580763:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663655424 00000100:00100000:2.0:1790778892.580821:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790778892.580829:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002be8ca98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+12:7453:x1877767663655424:12345-0@lo:101: 00010000:00010000:2.0:1790778892.580845:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778892.580861:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dea8c97d/0xb1aa4014e936c7f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c7ea expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.580916:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dea8c97d/0xb1aa4014e936c7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c7ea expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.580927:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dea8c97d/0xb1aa4014e936c7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c7ea expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.580937:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dea8c97d, rc 0) 00000100:00100000:2.0:1790778892.580981:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002be8ca98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+13:7453:x1877767663655424:12345-0@lo:101: Request processed in 154us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.580988:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790778892.581030:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663655168 00000100:00100000:2.0:1790778892.581039:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663655168 00000100:00100000:2.0:1790778892.581059:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778892.581063:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001628d064 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663655168:12345-0@lo:38: 00010000:00080000:2.0:1790778892.581085:0:6528:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1790778892.581142:0:6528:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936c7f8 00000004:00100000:2.0:1790778892.581161:0:6528:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1790778892.581168:0:6528:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1790778892.581253:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663655296 00000100:00100000:2.0:1790778892.581257:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663655296 00000100:00100000:2.0:1790778892.581284:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790778892.581289:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e54d1525 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663655296:12345-0@lo:400: 00000100:00100000:2.0:1790778892.581325:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e54d1525 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663655296:12345-0@lo:400: Request processed in 37us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.581331:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790778892.581381:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000491b6447 x1877767663655296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778892.581396:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000491b6447 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663655296:0@lo:400: 00000100:00100000:1.0:1790778892.581928:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cacfd31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655424:0@lo:101: 00010000:00010000:1.0:1790778892.581949:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.581960:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778892.582638:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cacfd31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655552:0@lo:256: 00000100:00100000:1.0:1790778892.582704:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.582744:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014c6dd5d going to sleep for 11 seconds 00000100:00100000:3.0:1790778892.582966:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663655552 00000100:00100000:3.0:1790778892.582974:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663655552 00000100:00100000:3.0:1790778892.583012:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790778892.583019:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008dc80670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+13:7453:x1877767663655552:12345-0@lo:256: 20000000:01000000:3.0:1790778892.583628:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790778892.583656:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790778892.583660:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1790778892.583774:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008dc80670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+13:7453:x1877767663655552:12345-0@lo:256: Request processed in 754us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778892.584113:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790778892.584330:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cacfd31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655552:0@lo:256: 10000000:01000000:1.0:1790778892.586373:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790778892.589665:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.589692:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778892.589701:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7712708000 from 1 10000000:01000000:1.0:1790778892.589706:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790778892.589762:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.589770:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.589782:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778892.589825:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cacfd31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655680:0@lo:101: 00000100:00100000:1.0:1790778892.589926:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.589975:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014c6dd5d going to sleep for 11 seconds 00000100:00100000:2.0:1790778892.590635:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663655680 00000100:00100000:2.0:1790778892.590646:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663655680 00000100:00100000:2.0:1790778892.590706:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790778892.590719:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ca5a2bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+13:7453:x1877767663655680:12345-0@lo:101: 00010000:00010000:2.0:1790778892.590736:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778892.590753:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f475edfe/0xb1aa4014e936c806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c7ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.590793:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f475edfe/0xb1aa4014e936c806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c7ff expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.590822:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f475edfe/0xb1aa4014e936c806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c7ff expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.590831:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f475edfe, rc 0) 00000100:00100000:2.0:1790778892.590927:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ca5a2bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+14:7453:x1877767663655680:12345-0@lo:101: Request processed in 212us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.590935:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790778892.592213:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cacfd31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655680:0@lo:101: 00010000:00010000:1.0:1790778892.592245:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778892.592258:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778892.592397:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cacfd31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655808:0@lo:501: 00000100:00100000:1.0:1790778892.592457:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.592495:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014c6dd5d going to sleep for 11 seconds 00000100:00100000:2.0:1790778892.592948:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663655808 00000100:00100000:2.0:1790778892.592957:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663655808 00000100:00100000:2.0:1790778892.593004:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790778892.593013:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c322c250 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+14:7453:x1877767663655808:12345-0@lo:501: 00000100:00100000:2.0:1790778892.593316:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c322c250 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+14:7453:x1877767663655808:12345-0@lo:501: Request processed in 303us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.593328:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790778892.593388:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cacfd31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655808:0@lo:501: 00000100:00100000:2.0:1790778892.593428:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d12781cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655936:0@lo:503: 00000100:00100000:2.0:1790778892.593479:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778892.593502:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000546b501a going to sleep for 11 seconds 00000100:00100000:2.0:1790778892.593517:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663655936 00000100:00100000:2.0:1790778892.593521:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663655936 00000100:00100000:2.0:1790778892.593543:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790778892.593548:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000063130ace pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+14:7453:x1877767663655936:12345-0@lo:503: 00000040:00080000:2.0:1790778892.593661:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790778892.593701:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000063130ace pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+14:7453:x1877767663655936:12345-0@lo:503: Request processed in 153us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.593709:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790778892.593758:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d12781cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663655936:0@lo:503: 00000040:00080000:2.0:1790778892.596743:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790778892.599325:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1790778892.599518:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1790778892.602358:0:6528:0:(import.c:65:import_set_state_nolock()) 0000000048d81c50 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778892.602512:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001628d064 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1877767663655168:12345-0@lo:38: Request processed in 21442us (22182us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778892.602534:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790778892.602619:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790778892.602630:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1790778892.602640:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1790778892.602647:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790778892.602650:0:3648:0:(import.c:65:import_set_state_nolock()) 0000000060a7a8bc lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790778892.602663:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a24eceb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663655168:0@lo:38: 00000040:00080000:2.0:1790778892.603614:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000100:00100000:0.0:1790778892.604044:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a73be46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663656064:0@lo:41: 00000100:00100000:0.0:1790778892.604156:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.604249:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663656064 00000100:00100000:0.0:1790778892.604259:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663656064 00000100:00100000:0.0:1790778892.604306:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778892.604315:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006513f55d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1877767663656064:12345-0@lo:41: 00000004:00000024:0.0:1790778892.604356:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1790778892.604434:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006513f55d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1877767663656064:12345-0@lo:41: Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.604442:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778892.604492:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a73be46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663656064:0@lo:41: 00000020:01000000:3.0:1790778892.605278:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1790778892.605345:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790778892.605371:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.605385:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778892.605458:0:7453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790778892.605461:0:7453:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b7712708000 10000000:01000000:3.0:1790778892.605465:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b7712708000 10000000:01000000:3.0:1790778892.605469:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790778892.605476:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b7712708000 from 1 10000000:01000000:3.0:1790778892.605479:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790778892.605529:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000069f0616d/0xb1aa4014e936c80d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.605537:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000069f0616d/0xb1aa4014e936c80d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.605547:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000069f0616d/0xb1aa4014e936c80d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778892.605567:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6594c39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656192:0@lo:101: 00000100:00100000:3.0:1790778892.605639:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778892.605673:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6214e65 going to sleep for 11 seconds 00000100:00100000:2.0:1790778892.605925:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663656192 00000100:00100000:2.0:1790778892.605933:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663656192 00000100:00100000:2.0:1790778892.605972:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790778892.605980:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fb1431dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+14:7453:x1877767663656192:12345-0@lo:101: 00010000:00010000:2.0:1790778892.605992:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778892.606005:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d400971d/0xb1aa4014e936c814 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c80d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.606030:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d400971d/0xb1aa4014e936c814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c80d expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.606039:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d400971d/0xb1aa4014e936c814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c80d expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.606048:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d400971d, rc 0) 00000100:00100000:2.0:1790778892.606087:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fb1431dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:7453:x1877767663656192:12345-0@lo:101: Request processed in 108us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.606105:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790778892.606420:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6594c39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656192:0@lo:101: 00010000:00010000:2.0:1790778892.606437:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000069f0616d/0xb1aa4014e936c80d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.606446:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000069f0616d/0xb1aa4014e936c80d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778892.606578:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d12781cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656320:0@lo:501: 00000100:00100000:2.0:1790778892.606619:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778892.606678:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ef3e531 going to sleep for 11 seconds 00000100:00100000:0.0:1790778892.613552:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663656320 00000100:00100000:0.0:1790778892.613586:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663656320 00000100:00100000:0.0:1790778892.613689:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790778892.613699:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000450c4b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:7453:x1877767663656320:12345-0@lo:501: 00000100:00100000:0.0:1790778892.613994:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000450c4b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:7453:x1877767663656320:12345-0@lo:501: Request processed in 296us (7374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.614003:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790778892.614419:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d12781cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656320:0@lo:501: 00000100:00100000:1.0:1790778892.614496:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000900d771b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656448:0@lo:503: 00000100:00100000:1.0:1790778892.614562:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.614618:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8bd722a going to sleep for 11 seconds 00000100:00100000:2.0:1790778892.614664:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663656448 00000100:00100000:2.0:1790778892.614669:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663656448 00000100:00100000:2.0:1790778892.614707:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790778892.614713:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d9505787 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:7453:x1877767663656448:12345-0@lo:503: 00000100:00100000:2.0:1790778892.614824:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d9505787 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:7453:x1877767663656448:12345-0@lo:503: Request processed in 111us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.614831:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790778892.615312:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000900d771b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656448:0@lo:503: 00000040:00080000:1.0:1790778892.615681:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790778892.615767:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000900d771b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656576:0@lo:502: 00000100:00100000:1.0:1790778892.615827:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.615861:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8bd722a going to sleep for 11 seconds 00000100:00100000:2.0:1790778892.616439:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663656576 00000100:00100000:2.0:1790778892.616448:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663656576 00000100:00100000:2.0:1790778892.616497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790778892.616506:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009747c977 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:7453:x1877767663656576:12345-0@lo:502: 00000100:00100000:2.0:1790778892.616651:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009747c977 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:7453:x1877767663656576:12345-0@lo:502: Request processed in 147us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.616660:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790778892.617524:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000900d771b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656576:0@lo:502: 00000040:00080000:1.0:1790778892.619469:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790778892.619538:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790778892.619552:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790778892.619739:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790778892.619759:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790778892.619770:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790778892.619853:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790778892.619867:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790778892.620079:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790778892.620105:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790778892.620129:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790778892.620153:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790778892.620166:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790778892.620178:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790778892.620190:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790778892.620203:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790778892.620216:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790778892.620228:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790778892.620241:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790778892.620252:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790778892.620264:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790778892.620277:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790778892.620290:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790778892.620305:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790778892.620319:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1790778892.620332:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1790778892.620346:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1790778892.620359:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1790778892.620416:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000900d771b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656704:0@lo:502: 00000100:00100000:1.0:1790778892.620516:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.620574:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8bd722a going to sleep for 11 seconds 00000100:00100000:0.0:1790778892.620948:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663656704 00000100:00100000:0.0:1790778892.620958:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663656704 00000100:00100000:0.0:1790778892.621023:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790778892.621031:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000db8da9a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:7453:x1877767663656704:12345-0@lo:502: 00000100:00100000:0.0:1790778892.621229:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000db8da9a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:7453:x1877767663656704:12345-0@lo:502: Request processed in 199us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.621238:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790778892.621403:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000900d771b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656704:0@lo:502: 00000040:00080000:3.0:1790778892.621483:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1790778892.621494:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1790778892.623034:0:7472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1790778892.623057:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000004e0050c3) 00000020:00000080:3.0:1790778892.623086:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1790778892.623406:0:7472:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006f2ca15e from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790778892.623412:0:7472:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006f2ca15e from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790778892.623415:0:7472:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006f2ca15e 3 00010000:00080000:3.0:1790778892.623455:0:7472:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000053834b67@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1790778892.629245:0:7472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1790778892.629508:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1790778892.629588:0:7472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790778892.629613:0:7472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb1aa4014e936c822 00000100:00080000:1.0:1790778892.629626:0:7472:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790778892.629639:0:7472:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000053834b67 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790778892.629686:0:7472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000085d28750 x1877767663656832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790778892.629734:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085d28750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877767663656832:0@lo:38: 00000100:00100000:1.0:1790778892.629836:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.629951:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663656832 00000100:00100000:1.0:1790778892.629960:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663656832 00000100:00100000:1.0:1790778892.629995:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790778892.630002:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b2d4a66a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1877767663656832:12345-0@lo:38: 00010000:00080000:1.0:1790778892.630031:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1790778892.630067:0:6524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb1aa4014e936c829 00000004:00100000:1.0:1790778892.630084:0:6524:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790778892.630120:0:6524:0:(import.c:65:import_set_state_nolock()) 00000000e652a1d2 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790778892.630178:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b2d4a66a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877767663656832:12345-0@lo:38: Request processed in 174us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778892.630187:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790778892.630227:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000085d28750 x1877767663656832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790778902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778892.630238:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790778892.630247:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1790778892.630255:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790778892.630259:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790778892.630262:0:3648:0:(import.c:65:import_set_state_nolock()) 0000000053834b67 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790778892.630268:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085d28750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877767663656832:0@lo:38: 00000100:00080000:1.0:1790778892.630299:0:7472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1790778892.638850:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1790778892.639673:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1790778892.639715:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790778892.639739:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000069f0616d/0xb1aa4014e936c80d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.639753:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000069f0616d/0xb1aa4014e936c80d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790778892.640703:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790778892.640707:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790778892.640709:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778892.640710:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790778892.640712:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778892.640714:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778892.640716:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790778892.640718:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790778892.640719:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790778892.640721:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778892.640722:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790778892.640726:0:7453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1790778892.640729:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790778892.640731:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790778892.640732:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778892.640733:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790778892.640733:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778892.640735:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778892.640736:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790778892.640736:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790778892.640737:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790778892.640738:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778892.640739:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 40000000:00080000:1.0:1790778892.641294:0:7474:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 10000000:01000000:0.0:1790778892.641466:0:7453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790778892.641499:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ebeff898 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656960:0@lo:253: 00000100:00100000:0.0:1790778892.643740:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778892.644319:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663656960 00000100:00100000:2.0:1790778892.644333:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663656960 00000100:00100000:2.0:1790778892.644399:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790778892.644409:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009a26a722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:7453:x1877767663656960:12345-0@lo:253: 20000000:01000000:2.0:1790778892.644453:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790778892.644472:0:6518:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790778892.645631:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e87f316 going to sleep for 11 seconds 00000001:00100000:0.0:1790778892.656629:0:6502:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1790778892.657520:0:6518:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790778892.657540:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1790778892.657693:0:6539:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790778892.657699:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790778892.657729:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.657753:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e2fc13a8/0xb1aa4014e936c750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c749 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.657761:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dea8c97d/0xb1aa4014e936c7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c7ea expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.657769:0:6539:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.657828:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dea8c97d/0xb1aa4014e936c7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c7ea expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.657844:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dea8c97d/0xb1aa4014e936c7f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c7ea expref: 15 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778892.657860:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048071c06 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663657088:0@lo:104: 00000100:00100000:0.0:1790778892.657968:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778892.658018:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e2fc13a8/0xb1aa4014e936c750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c749 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.658025:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e2fc13a8/0xb1aa4014e936c750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c749 expref: 15 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778892.658053:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011147302 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663657216:0@lo:104: 00000100:00100000:0.0:1790778892.658075:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.658104:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 000000008aba6d35 going to sleep for 11 seconds 00000100:00100000:0.0:1790778892.658422:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663657088 00000100:00100000:0.0:1790778892.658432:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663657088 00000100:00100000:0.0:1790778892.658472:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663657216 00000100:00100000:0.0:1790778892.658474:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663657216 00000100:00100000:0.0:1790778892.658487:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778892.658495:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d52a49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6539:x1877767663657088:12345-0@lo:104: 00010000:00010000:0.0:1790778892.658508:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.658579:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790778892.658584:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d52a49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6539:x1877767663657088:12345-0@lo:104: Request processed in 91us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.658591:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778892.658619:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790778892.658625:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bb082d9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6539:x1877767663657216:12345-0@lo:104: 00010000:00010000:0.0:1790778892.658631:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.658659:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790778892.658662:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bb082d9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6539:x1877767663657216:12345-0@lo:104: Request processed in 39us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.658667:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790778892.658686:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790778892.658691:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.658704:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007f022a77 already unused, calling callback (000000007093b7d7) 10000000:00010000:0.0:1790778892.658708:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.658716:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778892.658723:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778892.658728:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778892.658758:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.658764:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778892.658780:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.658785:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 000000007f022a77/0xb1aa4014e936c7ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c7f1 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.658801:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778892.658803:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.658807:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000035670265 already unused, calling callback (000000007093b7d7) 10000000:00010000:0.0:1790778892.658809:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.658825:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778892.658830:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778892.658835:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778892.658847:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.658852:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778892.658868:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.658967:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778892.659549:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 0000000035670265/0xb1aa4014e936c749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c750 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778892.659632:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778892.659634:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778892.659636:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778892.659665:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000054c882b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663657344:0@lo:103: 00000100:00100000:0.0:1790778892.659719:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778892.661551:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663657344 00000100:00100000:3.0:1790778892.661583:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663657344 00010000:00010000:3.0:1790778892.661647:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dea8c97d/0xb1aa4014e936c7f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c7ea expref: 16 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778892.661693:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790778892.661702:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004ed4d1e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+16:3650:x1877767663657344:12345-0@lo:103: 00010000:00010000:3.0:1790778892.661735:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778892.661742:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dea8c97d/0xb1aa4014e936c7f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c7ea expref: 16 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.661755:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dea8c97d/0xb1aa4014e936c7f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c7ea expref: 16 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.661788:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778892.661871:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004ed4d1e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+16:3650:x1877767663657344:12345-0@lo:103: Request processed in 171us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778892.661956:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778892.662381:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000054c882b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663657344:0@lo:103: 00000100:00100000:0.0:1790778892.662428:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee87544c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663657472:0@lo:103: 00000100:00100000:0.0:1790778892.662494:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778892.662817:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dea8c97d/0xb1aa4014e936c7f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c7ea expref: 15 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778892.662849:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048071c06 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663657088:0@lo:104: 00000100:00100000:0.0:1790778892.662863:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011147302 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663657216:0@lo:104: 00000100:00100000:3.0:1790778892.662934:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663657472 00000100:00100000:3.0:1790778892.662942:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663657472 00010000:00010000:3.0:1790778892.662964:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e2fc13a8/0xb1aa4014e936c750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c749 expref: 15 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778892.665577:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009a26a722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:7453:x1877767663656960:12345-0@lo:253: Request processed in 21149us (21827us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778892.665605:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790778892.667586:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ebeff898 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:7453:1877767663656960:0@lo:253: 10000000:01000000:1.0:1790778892.667625:0:7453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790778892.667629:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790778892.667631:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790778892.667633:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790778892.667634:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790778892.667635:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790778892.667636:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790778892.667638:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790778892.667640:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790778892.667641:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790778892.667643:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790778892.667644:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790778892.667662:0:7453:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1790778892.669963:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778892.670977:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790778892.671004:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000afcebf96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+14:3651:x1877767663657472:12345-0@lo:103: 00010000:00010000:3.0:1790778892.671030:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778892.671040:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e2fc13a8/0xb1aa4014e936c750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c749 expref: 14 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.671056:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e2fc13a8/0xb1aa4014e936c750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c749 expref: 14 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.671077:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e2fc13a8/0xb1aa4014e936c750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c749 expref: 14 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.671385:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.671429:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790778892.671450:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013751976s 00010000:00010000:3.0:1790778892.671455:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.671462:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.671470:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.671476:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.671481:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000099048d already unused, calling callback (0000000053eea93d) 00010000:00010000:3.0:1790778892.671486:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.671494:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.672293:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778892.672308:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.672360:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.672369:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000099048d/0xb1aa4014e936c830 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.672395:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778892.672742:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000afcebf96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+13:3651:x1877767663657472:12345-0@lo:103: Request processed in 1748us (10243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778892.672761:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790778892.673084:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee87544c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663657472:0@lo:103: 00080000:10000000:0.0:1790778892.684747:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1790778892.685872:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1790778892.687993:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1790778892.688389:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1790778892.689056:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1790778892.692733:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1790778892.698767:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1790778892.699102:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1790778892.700433:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1790778892.700659:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1790778892.700998:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1790778892.701401:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1790778892.711527:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1790778892.712335:0:7478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1790778892.712419:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b429eb5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1877767663657600:0@lo:700: 00000100:00100000:3.0:1790778892.712527:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778892.712611:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6214e65 going to sleep for 11 seconds 00000100:00100000:1.0:1790778892.712744:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663657600 00000100:00100000:1.0:1790778892.712755:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663657600 00000100:00100000:1.0:1790778892.712825:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790778892.712834:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002093797e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1877767663657600:12345-0@lo:700: 00000040:01000000:2.0:1790778892.719500:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1790778892.720786:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009eee7427 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1877767663657728:0@lo:1000: 00000100:00100000:3.0:1790778892.720914:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778892.720968:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000966979b7 going to sleep for 11 seconds 00000040:01000000:1.0:1790778892.723714:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1790778892.723925:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:2.0:1790778892.730296:0:6530:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000004:00000080:1.0:1790778892.731498:0:7453:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790778892.731524:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000020:00080000:0.0:1790778892.732263:0:7477:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1790778892.732270:0:7477:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790778892.733291:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663657728 00000100:00100000:0.0:1790778892.733309:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663657728 00000100:00100000:0.0:1790778892.733386:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790778892.733396:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ed9fa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1877767663657728:12345-0@lo:1000: 00000100:00100000:0.0:1790778892.733561:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ed9fa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1877767663657728:12345-0@lo:1000: Request processed in 166us (12647us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.733569:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790778892.733645:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009eee7427 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1877767663657728:0@lo:1000: 00000040:01000000:0.0:1790778892.733693:0:7479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1790778892.733743:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee87544c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1877767663657856:0@lo:700: 00000100:00100000:0.0:1790778892.733787:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.733830:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 000000008aba6d35 going to sleep for 11 seconds 00000040:00080000:1.0:1790778892.735725:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790778892.735963:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663657856 00000100:00100000:3.0:1790778892.735977:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663657856 00000100:00100000:3.0:1790778892.736042:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790778892.736052:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000011147302 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7479:x1877767663657856:12345-0@lo:700: 00000100:00100000:3.0:1790778892.736194:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000011147302 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7479:x1877767663657856:12345-0@lo:700: Request processed in 143us (2407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778892.736202:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778892.736362:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee87544c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1877767663657856:0@lo:700: 00000100:00100000:0.0:1790778892.736465:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee87544c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1877767663657984:0@lo:900: 00000100:00100000:0.0:1790778892.736510:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.736545:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 000000008aba6d35 going to sleep for 11 seconds 00000100:00100000:3.0:1790778892.738294:0:6534:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663657984 00000100:00100000:3.0:1790778892.738311:0:6534:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663657984 00000100:00100000:3.0:1790778892.738389:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790778892.738399:0:6534:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000048071c06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7479:x1877767663657984:12345-0@lo:900: 00000100:00100000:3.0:1790778892.738505:0:6534:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000048071c06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7479:x1877767663657984:12345-0@lo:900: Request processed in 107us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778892.738513:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790778892.738642:0:7479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ee87544c x1877767663657984/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790778908 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778892.738659:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee87544c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1877767663657984:0@lo:900: 00000100:00100000:0.0:1790778892.738802:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee87544c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1877767663658112:0@lo:1000: 00000100:00100000:0.0:1790778892.738848:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.738919:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663658112 00000100:00100000:0.0:1790778892.738923:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663658112 00000100:00100000:0.0:1790778892.738953:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790778892.738959:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000054c882b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1877767663658112:12345-0@lo:1000: 00000100:00100000:0.0:1790778892.739025:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000054c882b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1877767663658112:12345-0@lo:1000: Request processed in 66us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778892.739031:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790778892.739063:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4628b3f going to sleep for 11 seconds 00000100:00100000:0.0:1790778892.739078:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee87544c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1877767663658112:0@lo:1000: 00000100:00100000:2.0:1790778892.739301:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002093797e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1877767663657600:12345-0@lo:700: Request processed in 26468us (26775us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778892.739317:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790778892.739343:0:7478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007b429eb5 x1877767663657600/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790778908 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778892.739353:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b429eb5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1877767663657600:0@lo:700: 40000000:02000000:3.0:1790778892.739373:0:7478:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:0.0:1790778892.740002:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000008aba6d35 with version 0 00000020:00100000:0.0:1790778892.740039:0:7479:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1790778892.740044:0:7479:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ee87544c x1877767663658368/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790778892.740060:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee87544c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1877767663658368:0@lo:1000: 00000100:00100000:0.0:1790778892.740101:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778892.741295:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663658368 00000100:00100000:0.0:1790778892.741304:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663658368 00000100:00100000:0.0:1790778892.741370:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778892.741378:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005217bd19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1877767663658368:12345-0@lo:1000: 00000100:00100000:0.0:1790778892.741845:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7c3872 going to sleep for 11 seconds 00000040:00080000:1.0:1790778892.747300:0:7453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790778892.756780:0:7453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790778892.760103:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1790778892.760543:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1790778892.760558:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00080000:10000000:2.0:1790778892.760857:0:7453:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1790778892.761566:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1790778892.761745:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1790778892.761917:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1790778892.762055:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1790778892.762225:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1790778892.762535:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1790778892.762684:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1790778892.762818:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000100:00100000:1.0:1790778892.771319:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005217bd19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1877767663658368:12345-0@lo:1000: Request processed in 29932us (31207us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790778892.771361:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1790778892.771437:0:7479:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1790778892.771442:0:7479:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790778892.771460:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee87544c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1877767663658368:0@lo:1000: 00000100:00100000:1.0:1790778892.771790:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085d28750 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1877767663658496:0@lo:1000: 00000100:00100000:1.0:1790778892.771835:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.771917:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663658496 00000100:00100000:1.0:1790778892.771925:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663658496 00000100:00100000:1.0:1790778892.771970:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790778892.771978:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ba6baf94 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1877767663658496:12345-0@lo:1000: 00000100:00100000:1.0:1790778892.772050:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ba6baf94 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1877767663658496:12345-0@lo:1000: Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778892.772056:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790778892.772101:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0e8167b going to sleep for 11 seconds 00000100:00100000:1.0:1790778892.772115:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085d28750 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1877767663658496:0@lo:1000: 00000040:00080000:1.0:1790778892.772134:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1790778892.772167:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000014c6dd5d with version 1 00000004:00080000:1.0:1790778892.772186:0:7469:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000e0541e55 version 1 rpc_version 1 00000020:00100000:1.0:1790778892.772202:0:7469:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1790778892.772209:0:7469:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000085d28750 x1877767663658752/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790778892.772223:0:7469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085d28750 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7469:1877767663658752:0@lo:1000: 00000100:00100000:1.0:1790778892.772247:0:7469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778892.772270:0:7469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000025506b8 going to sleep for 11 seconds 00000100:00100000:1.0:1790778892.772282:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663658752 00000100:00100000:1.0:1790778892.772285:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663658752 00000100:00100000:1.0:1790778892.772304:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790778892.772309:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000652516d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7469:x1877767663658752:12345-0@lo:1000: 00100000:10000000:2.0:1790778892.776750:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1790778892.779907:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1790778892.780139:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1790778892.780323:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000040:00080000:3.0:1790778892.780371:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790778892.786079:0:7479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790778892.786201:0:7479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:0.0:1790778892.798970:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1790778892.799280:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000652516d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7469:x1877767663658752:12345-0@lo:1000: Request processed in 26964us (27026us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790778892.799297:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1790778892.799479:0:7469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1790778892.799486:0:7469:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790778892.799508:0:7469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085d28750 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7469:1877767663658752:0@lo:1000: 00100000:10000000:2.0:1790778892.799744:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1790778892.799997:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1790778892.800491:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1790778892.800651:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1790778892.801387:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1790778892.801511:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1790778892.801677:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000040:00080000:1.0:1790778892.802347:0:7478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790778892.802434:0:7478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790778892.802440:0:7478:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00100000:10000000:2.0:1790778892.802750:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1790778892.803006:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1790778892.803250:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1790778892.803410:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1790778892.803551:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1790778892.803706:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1790778892.803841:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1790778892.804651:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1790778892.805021:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1790778892.805386:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1790778892.805522:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1790778892.805702:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1790778892.805995:0:7453:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1790778892.806465:0:7453:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1790778892.811345:0:7453:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790778892.811405:0:7453:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbc92c188f988 00100000:10000000:0.0:1790778892.811416:0:7453:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1790778892.813605:0:7453:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790778892.813657:0:7453:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790778892.813685:0:7453:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1790778892.813712:0:7453:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1790778892.819663:0:7453:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790778892.822736:0:7453:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1790778893.225118:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778894.254332:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778895.273796:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778896.301599:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790778896.928235:0:7723:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790778897.320135:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790778897.887937:0:7776:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790778897.888193:0:7776:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790778898.027707:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663658880:0@lo:41: 00000100:00100000:0.0:1790778898.027837:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778898.028036:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663658880 00000100:00100000:1.0:1790778898.028045:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663658880 00000100:00100000:1.0:1790778898.028098:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790778898.028106:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a068deef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663658880:12345-0@lo:41: 00000004:00000024:1.0:1790778898.028143:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1790778898.028187:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a068deef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663658880:12345-0@lo:41: Request processed in 83us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778898.028195:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790778898.028329:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663658880:0@lo:41: 00000100:00100000:2.0:1790778898.031481:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000360c7ed6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663659264:0@lo:400: 00000100:00100000:2.0:1790778898.031756:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778898.031813:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663659264 00000100:00100000:2.0:1790778898.031821:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663659264 00000100:00100000:2.0:1790778898.031862:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790778898.031869:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000091cfa620 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663659264:12345-0@lo:400: 00000100:00100000:2.0:1790778898.031941:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000091cfa620 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663659264:12345-0@lo:400: Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.031948:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790778898.031989:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000360c7ed6 x1877767663659264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778898.032003:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000360c7ed6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663659264:0@lo:400: 00000100:00100000:1.0:1790778898.032482:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f924312d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663659008:0@lo:400: 00000100:00100000:1.0:1790778898.032522:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778898.033014:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790778898.033022:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eaadab48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663659136:0@lo:400: 00000100:00100000:1.0:1790778898.033049:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778898.033730:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663659008 00000100:00100000:0.0:1790778898.033738:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663659008 00000100:00100000:0.0:1790778898.034343:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790778898.034352:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003fc5bfaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+13:3649:x1877767663659008:12345-0@lo:400: 00000100:00100000:0.0:1790778898.034437:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003fc5bfaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+13:3649:x1877767663659008:12345-0@lo:400: Request processed in 87us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778898.034445:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790778898.035189:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f924312d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663659008:0@lo:400: 00000100:00100000:3.0:1790778898.035761:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663659136 00000100:00100000:3.0:1790778898.035768:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663659136 00000100:00100000:3.0:1790778898.035862:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790778898.035871:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000048bbc84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663659136:12345-0@lo:400: 00000100:00100000:3.0:1790778898.035950:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000048bbc84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663659136:12345-0@lo:400: Request processed in 82us (2900us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778898.035956:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790778898.036033:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000eaadab48 x1877767663659136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778898.036052:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eaadab48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663659136:0@lo:400: 00010000:00010000:3.0:1790778898.351673:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778899.369292:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778900.393645:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790778900.474998:0:7877:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778900.475222:0:7877:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1790778901.097429:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790778901.097436:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7712708000 from 4 10000000:01000000:1.0:1790778901.097441:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790778901.097494:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000e525ab48/0xb1aa4014e936c837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778901.097514:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000e525ab48/0xb1aa4014e936c837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778901.097524:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000e525ab48/0xb1aa4014e936c837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778901.097557:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663659392:0@lo:101: 00000100:00100000:1.0:1790778901.097620:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.097671:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf4f0975 going to sleep for 11 seconds 00000100:00100000:3.0:1790778901.097824:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663659392 00000100:00100000:3.0:1790778901.097832:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663659392 00000100:00100000:3.0:1790778901.097904:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790778901.097912:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000056863cf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+13:6520:x1877767663659392:12345-0@lo:101: 00010000:00010000:3.0:1790778901.097926:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778901.097939:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c5ae8847/0xb1aa4014e936c83e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c837 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.097960:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5ae8847/0xb1aa4014e936c83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c837 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.097969:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c5ae8847/0xb1aa4014e936c83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c837 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.097991:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c5ae8847, rc 0) 00000100:00100000:3.0:1790778901.098032:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000056863cf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+14:6520:x1877767663659392:12345-0@lo:101: Request processed in 120us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778901.098038:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790778901.098198:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663659392:0@lo:101: 00010000:00010000:1.0:1790778901.098211:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000e525ab48/0xb1aa4014e936c837 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778901.098219:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000e525ab48/0xb1aa4014e936c837 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778901.098278:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663659520:0@lo:256: 00000100:00100000:1.0:1790778901.098307:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.100077:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf4f0975 going to sleep for 11 seconds 00000100:00100000:3.0:1790778901.104675:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663659520 00000100:00100000:3.0:1790778901.104690:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663659520 00000100:00100000:3.0:1790778901.104741:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790778901.104749:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cce5d789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+14:6520:x1877767663659520:12345-0@lo:256: 20000000:01000000:3.0:1790778901.104775:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790778901.104791:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790778901.104795:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1790778901.104933:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cce5d789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+14:6520:x1877767663659520:12345-0@lo:256: Request processed in 185us (6625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778901.104942:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790778901.105049:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663659520:0@lo:256: 10000000:01000000:1.0:1790778901.105104:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790778901.105113:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000e525ab48/0xb1aa4014e936c837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778901.105123:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000e525ab48/0xb1aa4014e936c837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778901.105133:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790778901.105135:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b77208a9000 from 21 10000000:01000000:1.0:1790778901.105137:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790778901.105164:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000009874a336/0xb1aa4014e936c845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778901.105171:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000009874a336/0xb1aa4014e936c845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778901.105180:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000009874a336/0xb1aa4014e936c845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778901.105196:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663659648:0@lo:101: 00000100:00100000:1.0:1790778901.105226:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.105263:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf4f0975 going to sleep for 11 seconds 00000100:00100000:3.0:1790778901.105427:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663659648 00000100:00100000:3.0:1790778901.105432:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663659648 00000100:00100000:3.0:1790778901.105471:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790778901.105477:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007eb336db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+14:6520:x1877767663659648:12345-0@lo:101: 00010000:00010000:3.0:1790778901.105486:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778901.105497:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005637871d/0xb1aa4014e936c84c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c845 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.105525:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005637871d/0xb1aa4014e936c84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c845 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.105545:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005637871d/0xb1aa4014e936c84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c845 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.105565:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005637871d, rc 0) 00000100:00100000:3.0:1790778901.105593:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007eb336db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663659648:12345-0@lo:101: Request processed in 117us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778901.105599:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790778901.105788:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663659648:0@lo:101: 00010000:00010000:1.0:1790778901.105800:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000009874a336/0xb1aa4014e936c845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778901.105808:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000009874a336/0xb1aa4014e936c845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778901.105866:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663659776:0@lo:501: 00000100:00100000:1.0:1790778901.105928:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.105948:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf4f0975 going to sleep for 11 seconds 00000100:00100000:1.0:1790778901.105961:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663659776 00000100:00100000:1.0:1790778901.105965:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663659776 00000100:00100000:1.0:1790778901.105989:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790778901.105995:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009bf16482 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663659776:12345-0@lo:501: 00000100:00100000:1.0:1790778901.106107:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009bf16482 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663659776:12345-0@lo:501: Request processed in 112us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778901.106113:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790778901.106144:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663659776:0@lo:501: 00000100:00100000:1.0:1790778901.106168:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663659904:0@lo:503: 00000100:00100000:1.0:1790778901.106221:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.106233:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf4f0975 going to sleep for 11 seconds 00000100:00100000:1.0:1790778901.106244:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663659904 00000100:00100000:1.0:1790778901.106247:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663659904 00000100:00100000:1.0:1790778901.106268:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790778901.106274:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bc3d6e3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663659904:12345-0@lo:503: 00000100:00100000:1.0:1790778901.106356:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bc3d6e3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663659904:12345-0@lo:503: Request processed in 83us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778901.106363:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790778901.106401:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663659904:0@lo:503: 00000100:00100000:1.0:1790778901.106766:0:7900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:7900:1877767663660032:0@lo:502: 00000100:00100000:1.0:1790778901.106798:0:7900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.106825:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663660032 00000100:00100000:1.0:1790778901.106829:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663660032 00000100:00100000:1.0:1790778901.106850:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790778901.106855:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008e3328ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:7900:x1877767663660032:12345-0@lo:502: 00000100:00100000:1.0:1790778901.106955:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008e3328ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:7900:x1877767663660032:12345-0@lo:502: Request processed in 99us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778901.106961:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790778901.107003:0:7900:0:(client.c:2716:ptlrpc_set_wait()) set 00000000851c6f69 going to sleep for 11 seconds 00000100:00100000:1.0:1790778901.107014:0:7900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:7900:1877767663660032:0@lo:502: 00000100:00100000:1.0:1790778901.107049:0:7900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:7900:1877767663660160:0@lo:502: 00000100:00100000:1.0:1790778901.107078:0:7900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.107096:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663660160 00000100:00100000:1.0:1790778901.107099:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663660160 00000100:00100000:1.0:1790778901.107119:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790778901.107124:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000453386df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:7900:x1877767663660160:12345-0@lo:502: 00000100:00100000:1.0:1790778901.107173:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000453386df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:7900:x1877767663660160:12345-0@lo:502: Request processed in 50us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778901.107179:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790778901.107204:0:7900:0:(client.c:2716:ptlrpc_set_wait()) set 00000000851c6f69 going to sleep for 11 seconds 00000100:00100000:1.0:1790778901.107213:0:7900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:7900:1877767663660160:0@lo:502: 00000040:00080000:1.0:1790778901.107229:0:7900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1790778901.107276:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1790778901.107292:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790778901.107299:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000009874a336/0xb1aa4014e936c845 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778901.107308:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000009874a336/0xb1aa4014e936c845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778901.107324:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790778901.108273:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b77208a9000 from 4 10000000:01000000:1.0:1790778901.108279:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790778901.108304:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000034ca1e1f/0xb1aa4014e936c853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778901.108313:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000034ca1e1f/0xb1aa4014e936c853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778901.108322:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000034ca1e1f/0xb1aa4014e936c853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778901.108402:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663660288:0@lo:101: 00000100:00100000:1.0:1790778901.108444:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.108725:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000851c6f69 going to sleep for 11 seconds 00000100:00100000:3.0:1790778901.122614:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663660288 00000100:00100000:3.0:1790778901.122628:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663660288 00000100:00100000:3.0:1790778901.122681:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790778901.122687:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000da307ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663660288:12345-0@lo:101: 00010000:00010000:3.0:1790778901.122702:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778901.122779:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000050c695d0/0xb1aa4014e936c85a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c853 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.122965:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050c695d0/0xb1aa4014e936c85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c853 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.122976:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000050c695d0/0xb1aa4014e936c85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c853 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.122984:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000050c695d0, rc 0) 00000100:00100000:3.0:1790778901.123187:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000da307ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663660288:12345-0@lo:101: Request processed in 500us (14742us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778901.123196:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790778901.123254:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663660288:0@lo:101: 00010000:00010000:0.0:1790778901.123276:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000034ca1e1f/0xb1aa4014e936c853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.123286:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000034ca1e1f/0xb1aa4014e936c853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778901.123351:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000403084a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663660416:0@lo:256: 00000100:00100000:0.0:1790778901.123405:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778901.123447:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c04514c6 going to sleep for 11 seconds 00000100:00100000:2.0:1790778901.123681:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663660416 00000100:00100000:2.0:1790778901.123687:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663660416 00000100:00100000:2.0:1790778901.123729:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790778901.123736:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000547be2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663660416:12345-0@lo:256: 20000000:01000000:2.0:1790778901.123752:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790778901.123768:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790778901.123772:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1790778901.123868:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000547be2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663660416:12345-0@lo:256: Request processed in 132us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.123875:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790778901.123950:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000403084a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663660416:0@lo:256: 10000000:01000000:0.0:1790778901.123995:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790778901.124002:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000034ca1e1f/0xb1aa4014e936c853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.124010:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000034ca1e1f/0xb1aa4014e936c853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778901.124018:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790778901.124020:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1790778901.124023:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790778901.124043:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000036a5a7f7/0xb1aa4014e936c861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.124050:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000036a5a7f7/0xb1aa4014e936c861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.124068:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000036a5a7f7/0xb1aa4014e936c861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778901.124080:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000403084a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663660544:0@lo:101: 00000100:00100000:0.0:1790778901.124105:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778901.124129:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c04514c6 going to sleep for 11 seconds 00000100:00100000:2.0:1790778901.124392:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663660544 00000100:00100000:2.0:1790778901.124397:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663660544 00000100:00100000:2.0:1790778901.124429:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790778901.124436:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000087283f8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663660544:12345-0@lo:101: 00010000:00010000:2.0:1790778901.124443:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778901.124462:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000417e41f6/0xb1aa4014e936c868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c861 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778901.124486:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000417e41f6/0xb1aa4014e936c868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c861 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778901.124495:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000417e41f6/0xb1aa4014e936c868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c861 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778901.124512:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000417e41f6, rc 0) 00000100:00100000:2.0:1790778901.124554:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000087283f8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663660544:12345-0@lo:101: Request processed in 120us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.124560:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790778901.124590:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000403084a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663660544:0@lo:101: 00010000:00010000:2.0:1790778901.124601:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000036a5a7f7/0xb1aa4014e936c861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778901.124608:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000036a5a7f7/0xb1aa4014e936c861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778901.124656:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000360c7ed6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663660672:0@lo:501: 00000100:00100000:2.0:1790778901.124678:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778901.124695:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000329781ae going to sleep for 11 seconds 00000100:00100000:2.0:1790778901.124704:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663660672 00000100:00100000:2.0:1790778901.124708:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663660672 00000100:00100000:2.0:1790778901.124723:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790778901.124727:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009a9b9ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663660672:12345-0@lo:501: 00000100:00100000:2.0:1790778901.124839:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009a9b9ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663660672:12345-0@lo:501: Request processed in 111us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.124845:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790778901.124875:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000360c7ed6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663660672:0@lo:501: 00000100:00100000:2.0:1790778901.124929:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000360c7ed6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663660800:0@lo:503: 00000100:00100000:2.0:1790778901.124964:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778901.124976:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000329781ae going to sleep for 11 seconds 00000100:00100000:2.0:1790778901.124986:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663660800 00000100:00100000:2.0:1790778901.124990:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663660800 00000100:00100000:2.0:1790778901.125004:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790778901.125009:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009cd39a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663660800:12345-0@lo:503: 00000100:00100000:2.0:1790778901.125077:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009cd39a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663660800:12345-0@lo:503: Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.125084:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790778901.125119:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000360c7ed6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663660800:0@lo:503: 00000100:00100000:3.0:1790778901.139368:0:7901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b429eb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:7901:1877767663660928:0@lo:502: 00000100:00100000:3.0:1790778901.139447:0:7901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778901.139493:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663660928 00000100:00100000:3.0:1790778901.139495:0:7901:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ae29ded going to sleep for 11 seconds 00000100:00100000:2.0:1790778901.139503:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663660928 00000100:00100000:2.0:1790778901.139566:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790778901.139576:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e9690cb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:7901:x1877767663660928:12345-0@lo:502: 00000100:00100000:2.0:1790778901.139709:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e9690cb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:7901:x1877767663660928:12345-0@lo:502: Request processed in 135us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.139718:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790778901.139786:0:7901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b429eb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:7901:1877767663660928:0@lo:502: 00000020:01000000:3.0:1790778901.139821:0:7901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790778901.139832:0:7901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778901.139834:0:7901:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1790778901.139838:0:7901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790778901.139842:0:7901:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:3.0:1790778901.139863:0:7901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790778901.139908:0:7901:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000002e4847d) 00000020:00000080:3.0:1790778901.139930:0:7901:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1790778901.139937:0:7901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790778901.140069:0:7901:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1790778901.140074:0:7901:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790778901.140080:0:7901:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936c876 00010000:00080000:3.0:1790778901.140108:0:7901:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008f64a3b1@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1790778901.144553:0:7901:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1790778901.148807:0:7901:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790778901.150947:0:7901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790778901.151008:0:7901:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790778901.151034:0:7901:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936c87d 00000100:00080000:1.0:1790778901.151046:0:7901:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790778901.151058:0:7901:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000008f64a3b1 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790778901.151098:0:7901:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f7549cba x1877767663661056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790778901.151120:0:7901:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1790778901.151162:0:7901:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1790778901.151599:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000360c7ed6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663661184:0@lo:400: 00000100:00100000:2.0:1790778901.151658:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778901.151704:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000663a48b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663661312:0@lo:400: 00000100:00100000:2.0:1790778901.151734:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778901.151753:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778901.151759:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7a498f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663661440:0@lo:400: 00000100:00100000:2.0:1790778901.151777:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778901.151812:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663661184 00000100:00100000:2.0:1790778901.151831:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663661184 00000100:00100000:2.0:1790778901.151866:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663661440 00000100:00100000:2.0:1790778901.151869:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663661440 00000100:00100000:2.0:1790778901.151907:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790778901.151915:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000070594a9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663661184:12345-0@lo:400: 00000100:00100000:2.0:1790778901.151967:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000070594a9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663661184:12345-0@lo:400: Request processed in 52us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.151973:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790778901.151989:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790778901.151994:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f924312d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663661440:12345-0@lo:400: 00000100:00100000:2.0:1790778901.152023:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f924312d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663661440:12345-0@lo:400: Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.152029:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790778901.152046:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663661312 00000100:00100000:2.0:1790778901.152049:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663661312 00000100:00100000:2.0:1790778901.152071:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790778901.152077:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000eaadab48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663661312:12345-0@lo:400: 00000100:00100000:2.0:1790778901.152106:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000eaadab48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663661312:12345-0@lo:400: Request processed in 29us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.152112:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1790778901.152147:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e7a498f4 x1877767663661440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778901.152159:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7a498f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663661440:0@lo:400: 00000100:00100000:2.0:1790778901.152168:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000663a48b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663661312:0@lo:400: 00010000:00080000:2.0:1790778901.152208:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000360c7ed6 x1877767663661184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778901.152228:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000360c7ed6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663661184:0@lo:400: 00000100:00100000:3.0:1790778901.153585:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663661056:0@lo:38: 00000100:00100000:3.0:1790778901.153642:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778901.153858:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663661056 00000100:00100000:2.0:1790778901.153864:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663661056 00000100:00100000:2.0:1790778901.153905:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790778901.153910:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007b429eb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663661056:12345-0@lo:38: 00010000:00080000:2.0:1790778901.153937:0:6529:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:2.0:1790778901.153970:0:6529:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936c884 00000004:00100000:2.0:1790778901.153984:0:6529:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1790778901.153990:0:6529:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1790778901.156701:0:7905:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000007425dbe3 x1877767663661568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778901.156716:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set 00000000623e8b2b going to sleep for 0 seconds 00000020:01000000:0.0:1790778901.156836:0:7901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778901.156843:0:7901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778901.156845:0:7901:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1790778901.156848:0:7901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778901.156851:0:7901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778901.156853:0:7901:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790778901.156856:0:7901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790778901.156857:0:7901:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790778901.156900:0:7901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004ed4d1e6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:7901:1877767663661696:0@lo:502: 00000100:00100000:0.0:1790778901.156975:0:7901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778901.157013:0:7901:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1738aec going to sleep for 11 seconds 00000100:00100000:1.0:1790778901.157081:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663661696 00000100:00100000:1.0:1790778901.157090:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663661696 00000100:00100000:1.0:1790778901.157129:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790778901.157143:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003b83db49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:7901:x1877767663661696:12345-0@lo:502: 00000100:00100000:1.0:1790778901.157280:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003b83db49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:7901:x1877767663661696:12345-0@lo:502: Request processed in 138us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778901.157289:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790778901.157749:0:7901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004ed4d1e6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:7901:1877767663661696:0@lo:502: 00000020:01000000:0.0:1790778901.157778:0:7901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778901.157783:0:7901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778901.157785:0:7901:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790778901.157788:0:7901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1790778901.157975:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1790778901.157998:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790778901.158006:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000036a5a7f7/0xb1aa4014e936c861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.158016:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000036a5a7f7/0xb1aa4014e936c861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778901.158026:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790778901.158028:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b773059cd40 from 1 10000000:01000000:3.0:1790778901.158038:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790778901.158067:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000009ea9b354/0xb1aa4014e936c88b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.158074:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000009ea9b354/0xb1aa4014e936c88b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.158081:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000009ea9b354/0xb1aa4014e936c88b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778901.158095:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032dec52b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663661824:0@lo:101: 00000100:00100000:3.0:1790778901.158133:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778901.158160:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000008056b10c going to sleep for 11 seconds 00000100:00100000:3.0:1790778901.158444:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663661824 00000100:00100000:3.0:1790778901.158450:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663661824 00000100:00100000:3.0:1790778901.164748:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790778901.164773:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fda713ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663661824:12345-0@lo:101: 00010000:00010000:3.0:1790778901.164802:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778901.164821:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000009f2c497/0xb1aa4014e936c892 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c88b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.164851:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009f2c497/0xb1aa4014e936c892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c88b expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.164863:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000009f2c497/0xb1aa4014e936c892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c88b expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.164872:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000009f2c497, rc 0) 00000100:00100000:3.0:1790778901.165143:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fda713ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663661824:12345-0@lo:101: Request processed in 381us (7008us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778901.165170:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790778901.165246:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032dec52b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663661824:0@lo:101: 00010000:00010000:3.0:1790778901.165263:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000009ea9b354/0xb1aa4014e936c88b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.165272:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000009ea9b354/0xb1aa4014e936c88b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778901.165354:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032dec52b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663661952:0@lo:501: 00000100:00100000:3.0:1790778901.165402:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778901.165449:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000008056b10c going to sleep for 11 seconds 00000100:00100000:3.0:1790778901.165468:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663661952 00000100:00100000:3.0:1790778901.165473:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663661952 00000100:00100000:3.0:1790778901.165500:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790778901.165503:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f27668a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663661952:12345-0@lo:501: 00000100:00100000:3.0:1790778901.165608:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f27668a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663661952:12345-0@lo:501: Request processed in 102us (207us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790778901.165617:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790778901.165660:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032dec52b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663661952:0@lo:501: 10000000:01000000:3.0:1790778901.165698:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790778901.165705:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000009ea9b354/0xb1aa4014e936c88b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.165712:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000009ea9b354/0xb1aa4014e936c88b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790778901.180700:0:6529:0:(import.c:65:import_set_state_nolock()) 000000000e57f1c8 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778901.180805:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007b429eb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1877767663661056:12345-0@lo:38: Request processed in 26891us (27161us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778901.180815:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790778901.180955:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790778901.180964:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790778901.180971:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1790778901.180976:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790778901.180978:0:3648:0:(import.c:65:import_set_state_nolock()) 000000008f64a3b1 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1790778901.180989:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000623e8b2b): req@000000007425dbe3 x1877767663661568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778901.181005:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7549cba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663661056:0@lo:38: 00000100:00100000:1.0:1790778901.181070:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.181099:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663661568 00000100:00100000:1.0:1790778901.181104:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663661568 00000100:00100000:1.0:1790778901.181138:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790778901.181145:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f7549cba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7905:x1877767663661568:12345-0@lo:1000: 00000100:00100000:1.0:1790778901.181329:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f7549cba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7905:x1877767663661568:12345-0@lo:1000: Request processed in 185us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778901.181337:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790778901.181374:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007425dbe3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7905:1877767663661568:0@lo:1000: 00000040:01000000:1.0:1790778901.181404:0:7905:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1790778901.181438:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7905:1877767663662080:0@lo:1000: 00000100:00100000:1.0:1790778901.181466:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.181482:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663662080 00000100:00100000:1.0:1790778901.181485:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663662080 00000100:00100000:1.0:1790778901.181512:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790778901.181517:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000085d28750 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7905:x1877767663662080:12345-0@lo:1000: 00000100:00100000:1.0:1790778901.181613:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000085d28750 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7905:x1877767663662080:12345-0@lo:1000: Request processed in 96us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778901.181620:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790778901.181638:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set 000000001ce5107a going to sleep for 11 seconds 00000100:00100000:1.0:1790778901.181649:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7905:1877767663662080:0@lo:1000: 00000100:00100000:1.0:1790778901.181682:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7905:1877767663662208:0@lo:700: 00000100:00100000:1.0:1790778901.181704:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.181729:0:6533:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663662208 00000100:00100000:1.0:1790778901.181732:0:6533:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663662208 00000100:00100000:1.0:1790778901.181754:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790778901.181759:0:6533:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000900d771b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7905:x1877767663662208:12345-0@lo:700: 00000100:00100000:1.0:1790778901.181791:0:6533:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000900d771b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7905:x1877767663662208:12345-0@lo:700: Request processed in 32us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778901.181796:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790778901.181811:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b872c1c3 going to sleep for 11 seconds 00000100:00100000:1.0:1790778901.181823:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7905:1877767663662208:0@lo:700: 00000100:00100000:2.0:1790778901.182350:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032dec52b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663662336:0@lo:41: 00000100:00100000:2.0:1790778901.182390:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778901.183337:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663662336 00000100:00100000:3.0:1790778901.183348:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663662336 00000100:00100000:3.0:1790778901.183397:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790778901.183405:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000360c7ed6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663662336:12345-0@lo:41: 00000004:00000024:3.0:1790778901.183439:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1790778901.183550:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000360c7ed6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663662336:12345-0@lo:41: Request processed in 147us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778901.183558:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790778901.183706:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032dec52b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663662336:0@lo:41: 00000100:00100000:1.0:1790778901.183924:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7905:1877767663662464:0@lo:1000: 00000100:00100000:1.0:1790778901.183960:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.183975:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dcad0ff7 going to sleep for 11 seconds 00000100:00100000:3.0:1790778901.184088:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663662464 00000100:00100000:3.0:1790778901.184093:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663662464 00000100:00100000:3.0:1790778901.184117:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790778901.184122:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006a24eceb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7905:x1877767663662464:12345-0@lo:1000: 00000100:00100000:3.0:1790778901.184390:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006a24eceb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7905:x1877767663662464:12345-0@lo:1000: Request processed in 266us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778901.184397:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790778901.184457:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7905:1877767663662464:0@lo:1000: 00000004:00080000:1.0:1790778901.184507:0:7905:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b872c1c3 with version 0 00000020:00100000:1.0:1790778901.184521:0:7905:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1790778901.184526:0:7905:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006ce95f32 x1877767663662720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790778901.184568:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7905:1877767663662720:0@lo:1000: 00000100:00100000:1.0:1790778901.184594:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.184646:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6e62bc4 going to sleep for 11 seconds 00000100:00100000:2.0:1790778901.189973:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663662720 00000100:00100000:2.0:1790778901.189988:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663662720 00000100:00100000:2.0:1790778901.190080:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790778901.190089:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006cacfd31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7905:x1877767663662720:12345-0@lo:1000: 00000001:00080000:2.0:1790778901.201551:0:7455:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1790778901.201569:0:7455:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790778901.202035:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006cacfd31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7905:x1877767663662720:12345-0@lo:1000: Request processed in 11942us (17434us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790778901.202054:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1790778901.202291:0:7905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1790778901.202303:0:7905:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790778901.202328:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7905:1877767663662720:0@lo:1000: 00000100:00100000:1.0:1790778901.202435:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7905:1877767663662848:0@lo:1000: 00000100:00100000:1.0:1790778901.202494:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.204400:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set 000000001ce5107a going to sleep for 11 seconds 00000100:00100000:3.0:1790778901.214036:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663662848 00000100:00100000:3.0:1790778901.214052:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663662848 00000100:00100000:3.0:1790778901.214112:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790778901.214122:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000491b6447 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7905:x1877767663662848:12345-0@lo:1000: 00000100:00100000:3.0:1790778901.214255:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000491b6447 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7905:x1877767663662848:12345-0@lo:1000: Request processed in 136us (11761us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778901.214263:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790778901.214406:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ce95f32 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7905:1877767663662848:0@lo:1000: 00000040:00080000:1.0:1790778901.214438:0:7905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1790778901.214475:0:7905:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b872c1c3 with version 1 00000004:00080000:2.0:1790778901.214933:0:7903:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000006fa2c295 version 1 rpc_version 1 00000020:00100000:2.0:1790778901.214987:0:7903:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1790778901.214999:0:7903:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000663a48b2 x1877767663663104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790778901.215047:0:7903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000663a48b2 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7903:1877767663663104:0@lo:1000: 00000100:00100000:2.0:1790778901.215141:0:7903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778901.215194:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663663104 00000100:00100000:2.0:1790778901.215202:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663663104 00000100:00100000:2.0:1790778901.215254:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790778901.215263:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a498f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7903:x1877767663663104:12345-0@lo:1000: 00000100:00100000:2.0:1790778901.215766:0:7903:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bafca9b8 going to sleep for 11 seconds 00000001:00080000:2.0:1790778901.217691:0:7455:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1790778901.217939:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a498f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7903:x1877767663663104:12345-0@lo:1000: Request processed in 2615us (2737us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790778901.217956:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1790778901.218122:0:7903:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1790778901.218129:0:7903:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790778901.218157:0:7903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000663a48b2 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7903:1877767663663104:0@lo:1000: 00000040:00080000:1.0:1790778901.219475:0:7905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790778901.219566:0:7905:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790778901.219571:0:7905:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1790778901.421375:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790778901.559311:0:7930:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1eacc1e0 20000000:00000080:2.0:1790778901.560364:0:7930:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b773b509400 uarg=0000000000000000 20000000:01000000:2.0:1790778901.560433:0:7930:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790778901.560441:0:7930:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790778901.560445:0:7930:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790778901.560520:0:7930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1790778901.560545:0:7930:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1790778901.565965:0:7930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778901.566757:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790778901.566794:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1790778901.566810:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1790778901.566827:0:7930:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790778901.566845:0:7930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.566864:0:7930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ee3ff3f8/0xb1aa4014e936c718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c711 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.566870:0:7930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f475edfe/0xb1aa4014e936c806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c7ff expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.566876:0:7930:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.566951:0:7930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f475edfe/0xb1aa4014e936c806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c7ff expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.566963:0:7930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f475edfe/0xb1aa4014e936c806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c7ff expref: 17 pid: 6518 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778901.566977:0:7930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0bcce5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1877767663663232:0@lo:104: 00000100:00100000:3.0:1790778901.568935:0:7930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790778901.569005:0:7930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ee3ff3f8/0xb1aa4014e936c718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c711 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.569339:0:7930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ee3ff3f8/0xb1aa4014e936c718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c711 expref: 17 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778901.569353:0:7930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2cb4f35 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1877767663663360:0@lo:104: 00000100:00100000:3.0:1790778901.569394:0:7930:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063ba6261 going to sleep for 11 seconds 00000100:00100000:0.0:1790778901.570929:0:6506:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790778901.570966:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778901.571006:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663663232 00000100:00100000:0.0:1790778901.571014:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663663232 00000100:00100000:0.0:1790778901.571049:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663663360 00000100:00100000:0.0:1790778901.571052:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663663360 00000100:00100000:0.0:1790778901.571082:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790778901.571089:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000028ab6c7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+4:7930:x1877767663663232:12345-0@lo:104: 00010000:00010000:0.0:1790778901.571105:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571180:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790778901.571185:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000028ab6c7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+4:7930:x1877767663663232:12345-0@lo:104: Request processed in 97us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778901.571192:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790778901.571253:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790778901.571259:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004ed4d1e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:7930:x1877767663663360:12345-0@lo:104: 00010000:00010000:0.0:1790778901.571266:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571301:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790778901.571306:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004ed4d1e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:7930:x1877767663663360:12345-0@lo:104: Request processed in 48us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778901.571311:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1790778901.571341:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790778901.571347:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571354:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003c720bd9 already unused, calling callback (000000007093b7d7) 10000000:00010000:0.0:1790778901.571358:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571366:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778901.571384:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778901.571389:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790778901.571427:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571434:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778901.571452:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571458:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 000000003c720bd9/0xb1aa4014e936c7ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c806 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571469:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778901.571471:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571476:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f47ca50f already unused, calling callback (000000007093b7d7) 10000000:00010000:0.0:1790778901.571478:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571483:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778901.571487:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778901.571492:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790778901.571510:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571516:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778901.571540:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571546:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000f47ca50f/0xb1aa4014e936c711 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c718 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.571559:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778901.571560:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778901.571562:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778901.571576:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9d52a49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663663488:0@lo:103: 00000100:00100000:0.0:1790778901.571609:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778901.571642:0:7930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0bcce5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1877767663663232:0@lo:104: 00010000:00010000:1.0:1790778901.571669:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778901.571680:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663663488 00000100:00100000:2.0:1790778901.571685:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663663488 00000100:00100000:1.0:1790778901.571698:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb082d9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663663616:0@lo:103: 00010000:00010000:2.0:1790778901.571704:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f475edfe/0xb1aa4014e936c806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c7ff expref: 18 pid: 6518 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778901.571727:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790778901.571732:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ebeff898 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+18:3652:x1877767663663488:12345-0@lo:103: 00010000:00010000:2.0:1790778901.571741:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778901.571745:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f475edfe/0xb1aa4014e936c806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c7ff expref: 18 pid: 6518 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778901.571759:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f475edfe/0xb1aa4014e936c806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c7ff expref: 18 pid: 6518 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778901.571770:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f475edfe/0xb1aa4014e936c806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c7ff expref: 18 pid: 6518 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778901.571781:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778901.577208:0:7930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2cb4f35 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1877767663663360:0@lo:104: 00010000:00010000:3.0:1790778901.577240:0:7930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778901.578928:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778901.578978:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663663616 00000100:00100000:3.0:1790778901.578987:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663663616 00010000:00010000:3.0:1790778901.579023:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ee3ff3f8/0xb1aa4014e936c718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c711 expref: 18 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778901.579057:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790778901.579064:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006ce95f32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+18:3649:x1877767663663616:12345-0@lo:103: 00010000:00010000:3.0:1790778901.579079:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778901.579082:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ee3ff3f8/0xb1aa4014e936c718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c711 expref: 18 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579093:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ee3ff3f8/0xb1aa4014e936c718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c711 expref: 18 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579108:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee3ff3f8/0xb1aa4014e936c718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c711 expref: 18 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579124:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579132:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579145:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579163:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579169:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579175:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579180:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001cb04060 already unused, calling callback (0000000053eea93d) 00010000:00010000:3.0:1790778901.579183:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579190:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579211:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778901.579220:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778901.579259:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006ce95f32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+17:3649:x1877767663663616:12345-0@lo:103: Request processed in 196us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778901.579266:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1790778901.579407:0:7930:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.579416:0:7930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778901.579422:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001cb04060/0xb1aa4014e936c899 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778901.580943:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb082d9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663663616:0@lo:103: 00000100:00100000:2.0:1790778901.581151:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ebeff898 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+16:3652:x1877767663663488:12345-0@lo:103: Request processed in 9418us (9542us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.581162:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790778901.582150:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9d52a49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663663488:0@lo:103: 00010000:00010000:0.0:1790778902.440998:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778903.144241:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bea34a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663663744:0@lo:41: 00000100:00100000:0.0:1790778903.144377:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778903.144504:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663663744 00000100:00100000:0.0:1790778903.144514:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663663744 00000100:00100000:0.0:1790778903.144603:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790778903.144613:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d52a49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663663744:12345-0@lo:41: 00000004:00000024:0.0:1790778903.144665:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1790778903.144741:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d52a49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663663744:12345-0@lo:41: Request processed in 130us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778903.144749:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790778903.145039:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bea34a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663663744:0@lo:41: 00010000:00010000:1.0:1790778903.465162:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778904.492281:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778905.512070:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778906.217127:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000675c728c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663664128:0@lo:400: 00000100:00100000:1.0:1790778906.217227:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778906.217327:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fced5a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663664256:0@lo:400: 00000100:00100000:1.0:1790778906.217362:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778906.217417:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663664256 00000100:00100000:1.0:1790778906.217428:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663664256 00000100:00100000:1.0:1790778906.217481:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790778906.217490:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007bea34a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663664256:12345-0@lo:400: 00000100:00100000:1.0:1790778906.217568:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007bea34a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663664256:12345-0@lo:400: Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778906.217576:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790778906.217621:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fced5a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663664256:0@lo:400: 00000100:00100000:2.0:1790778906.218244:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663664128 00000100:00100000:2.0:1790778906.218252:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663664128 00000100:00100000:2.0:1790778906.218292:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790778906.218300:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008f0b3921 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663664128:12345-0@lo:400: 00000100:00100000:0.0:1790778906.218321:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000663a48b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663663872:0@lo:41: 00000100:00100000:2.0:1790778906.218366:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008f0b3921 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663664128:12345-0@lo:400: Request processed in 67us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778906.218370:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778906.218373:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790778906.218402:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fced5a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663664384:0@lo:400: 00010000:00080000:2.0:1790778906.218414:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000675c728c x1877767663664128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778906.218425:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778906.218428:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000675c728c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663664128:0@lo:400: 00000100:00100000:0.0:1790778906.218445:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790778906.218452:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007467f5a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663664000:0@lo:400: 00000100:00100000:0.0:1790778906.218480:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778906.218522:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000410fe889 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663664512:0@lo:400: 00000100:00100000:0.0:1790778906.218542:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778906.218569:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663663872 00000100:00100000:0.0:1790778906.218573:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663663872 00000100:00100000:0.0:1790778906.218595:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663664512 00000100:00100000:0.0:1790778906.218597:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663664512 00000100:00100000:0.0:1790778906.218608:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790778906.218612:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005356fbfa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663663872:12345-0@lo:41: 00000004:00000024:0.0:1790778906.218650:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1790778906.218689:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005356fbfa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663663872:12345-0@lo:41: Request processed in 77us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778906.218696:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790778906.218699:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663664000 00000100:00100000:2.0:1790778906.218703:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663664000 00000100:00100000:0.0:1790778906.218709:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790778906.218715:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000edd7a0e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663664512:12345-0@lo:400: 00000100:00100000:2.0:1790778906.218731:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790778906.218736:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2aca3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:3651:x1877767663664000:12345-0@lo:400: 00000100:00100000:0.0:1790778906.218754:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000edd7a0e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663664512:12345-0@lo:400: Request processed in 40us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778906.218760:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790778906.218762:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2aca3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:3651:x1877767663664000:12345-0@lo:400: Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778906.218777:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790778906.219238:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663664384 00000100:00100000:0.0:1790778906.219244:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663664384 00000100:00100000:0.0:1790778906.219270:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790778906.219277:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003893ad44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663664384:12345-0@lo:400: 00000100:00100000:0.0:1790778906.219317:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003893ad44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663664384:12345-0@lo:400: Request processed in 41us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778906.219323:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790778906.219374:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007467f5a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663664000:0@lo:400: 00000100:00100000:0.0:1790778906.219387:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000410fe889 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663664512:0@lo:400: 00000100:00100000:0.0:1790778906.219401:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000663a48b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663663872:0@lo:41: 00010000:00080000:0.0:1790778906.219411:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005fced5a8 x1877767663664384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778906.219422:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fced5a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663664384:0@lo:400: 00010000:00010000:1.0:1790778906.536073:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778907.560767:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778908.272997:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008341cd42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663664640:0@lo:41: 00000100:00100000:2.0:1790778908.273071:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778908.273184:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663664640 00000100:00100000:0.0:1790778908.273193:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663664640 00000100:00100000:0.0:1790778908.273242:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790778908.273249:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000aa589b3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663664640:12345-0@lo:41: 00000004:00000024:0.0:1790778908.273283:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1790778908.277324:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000aa589b3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663664640:12345-0@lo:41: Request processed in 4067us (4245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778908.277343:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008341cd42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663664640:0@lo:41: 00000100:00100000:0.0:1790778908.277406:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1790778908.584049:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778909.622755:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790778909.813710:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790778909.813721:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7712708000 from 1 10000000:01000000:3.0:1790778909.813729:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790778909.813797:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000004fe18cbe/0xb1aa4014e936c8a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778909.814088:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000004fe18cbe/0xb1aa4014e936c8a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778909.814102:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000004fe18cbe/0xb1aa4014e936c8a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778909.814200:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2cb4f35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663664768:0@lo:101: 00000100:00100000:3.0:1790778909.814296:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778909.814387:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 0000000033858964 going to sleep for 11 seconds 00000100:00100000:1.0:1790778909.822100:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663664768 00000100:00100000:1.0:1790778909.822133:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663664768 00000100:00100000:1.0:1790778909.822219:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790778909.822230:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001a07771e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663664768:12345-0@lo:101: 00010000:00010000:1.0:1790778909.822255:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778909.822280:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c720bd9/0xb1aa4014e936c8a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c8a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778909.822315:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c720bd9/0xb1aa4014e936c8a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c8a0 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778909.822328:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c720bd9/0xb1aa4014e936c8a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c8a0 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778909.822337:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c720bd9, rc 0) 00000100:00100000:1.0:1790778909.822447:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001a07771e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663664768:12345-0@lo:101: Request processed in 218us (8151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778909.822478:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790778909.822559:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2cb4f35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663664768:0@lo:101: 00010000:00010000:1.0:1790778909.822585:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000004fe18cbe/0xb1aa4014e936c8a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778909.822595:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000004fe18cbe/0xb1aa4014e936c8a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778909.822697:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dd29e70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663664896:0@lo:501: 00000100:00100000:1.0:1790778909.822736:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778909.822768:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663664896 00000100:00100000:1.0:1790778909.822772:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663664896 00000100:00100000:1.0:1790778909.822799:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790778909.822806:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e35c4b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663664896:12345-0@lo:501: 00000100:00100000:1.0:1790778909.822974:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e35c4b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663664896:12345-0@lo:501: Request processed in 169us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778909.822982:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790778909.823021:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000000dc0cdf7 going to sleep for 11 seconds 00000100:00100000:1.0:1790778909.823033:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dd29e70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663664896:0@lo:501: 00000100:00100000:1.0:1790778909.823066:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dd29e70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663665024:0@lo:503: 00000100:00100000:1.0:1790778909.823111:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778909.823132:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663665024 00000100:00100000:1.0:1790778909.823136:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663665024 00000100:00100000:1.0:1790778909.823158:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790778909.823164:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000048c59275 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663665024:12345-0@lo:503: 00000100:00100000:1.0:1790778909.823249:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000048c59275 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663665024:12345-0@lo:503: Request processed in 85us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778909.823262:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790778909.823295:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000000dc0cdf7 going to sleep for 11 seconds 00000100:00100000:1.0:1790778909.823307:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dd29e70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663665024:0@lo:503: 00000100:00100000:1.0:1790778909.823591:0:8313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dd29e70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8313:1877767663665152:0@lo:502: 00000100:00100000:1.0:1790778909.823626:0:8313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778909.823645:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663665152 00000100:00100000:1.0:1790778909.823648:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663665152 00000100:00100000:1.0:1790778909.823668:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790778909.823673:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000080da9f63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:8313:x1877767663665152:12345-0@lo:502: 00000100:00100000:1.0:1790778909.823760:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000080da9f63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:8313:x1877767663665152:12345-0@lo:502: Request processed in 86us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778909.823766:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790778909.823795:0:8313:0:(client.c:2716:ptlrpc_set_wait()) set 000000005585aab8 going to sleep for 11 seconds 00000100:00100000:1.0:1790778909.823806:0:8313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dd29e70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8313:1877767663665152:0@lo:502: 00000020:01000000:1.0:1790778909.823828:0:8313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778909.823839:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778909.823842:0:8313:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790778909.823850:0:8313:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b7712708000 00000020:00000080:1.0:1790778909.823853:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790778909.823925:0:8313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8313:1877767663665280:0@lo:502: 00000100:00100000:1.0:1790778909.823957:0:8313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778909.823978:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663665280 00000100:00100000:1.0:1790778909.823981:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663665280 00000100:00100000:1.0:1790778909.824002:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790778909.824008:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:8313:x1877767663665280:12345-0@lo:502: 00000100:00100000:1.0:1790778909.824084:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:8313:x1877767663665280:12345-0@lo:502: Request processed in 76us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778909.824097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790778909.824125:0:8313:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77108d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790778909.824137:0:8313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8313:1877767663665280:0@lo:502: 00000020:01000000:1.0:1790778909.824154:0:8313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778909.824158:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778909.824160:0:8313:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790778909.824163:0:8313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1790778909.824239:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790778909.824264:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790778909.824273:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663200/0xb1aa4014e936c8a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778909.824284:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7701663200/0xb1aa4014e936c8a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778909.824294:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790778909.824297:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b77208a9000 from 1 10000000:01000000:1.0:1790778909.824300:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790778909.824324:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778909.824333:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778909.824344:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778909.824356:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663665408:0@lo:101: 00000100:00100000:1.0:1790778909.824382:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778909.824403:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77108d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790778909.824416:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663665408 00000100:00100000:1.0:1790778909.824419:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663665408 00000100:00100000:1.0:1790778909.824440:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790778909.824446:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663665408:12345-0@lo:101: 00010000:00010000:1.0:1790778909.824456:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778909.824477:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894b800/0xb1aa4014e936c8b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c8ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778909.824499:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894b800/0xb1aa4014e936c8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c8ae expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778909.824510:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894b800/0xb1aa4014e936c8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c8ae expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778909.824520:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b800, rc 0) 00000100:00100000:1.0:1790778909.824550:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663665408:12345-0@lo:101: Request processed in 104us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778909.824557:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790778909.824587:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663665408:0@lo:101: 00010000:00010000:1.0:1790778909.824601:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778909.824610:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778909.824656:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663665536:0@lo:501: 00000100:00100000:1.0:1790778909.824682:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778909.824695:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77108d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790778909.824712:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663665536 00000100:00100000:1.0:1790778909.824716:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663665536 00000100:00100000:1.0:1790778909.824739:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790778909.824746:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663665536:12345-0@lo:501: 00000100:00100000:1.0:1790778909.824839:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663665536:12345-0@lo:501: Request processed in 94us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778909.824847:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790778909.824902:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663665536:0@lo:501: 00000100:00100000:1.0:1790778909.824930:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663665664:0@lo:503: 00000100:00100000:1.0:1790778909.824965:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778909.824978:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77108d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790778909.824990:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663665664 00000100:00100000:1.0:1790778909.824994:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663665664 00000100:00100000:1.0:1790778909.825013:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790778909.825019:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663665664:12345-0@lo:503: 00000100:00100000:1.0:1790778909.825088:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663665664:12345-0@lo:503: Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778909.825096:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790778909.825134:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663665664:0@lo:503: 00000100:00100000:1.0:1790778909.825428:0:8314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8314:1877767663665792:0@lo:502: 00000100:00100000:1.0:1790778909.841568:0:8314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778909.841700:0:8314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711f8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778909.841773:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663665792 00000100:00100000:2.0:1790778909.841787:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663665792 00000100:00100000:2.0:1790778909.841864:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790778909.841875:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:8314:x1877767663665792:12345-0@lo:502: 00000100:00100000:2.0:1790778909.842674:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:8314:x1877767663665792:12345-0@lo:502: Request processed in 797us (17204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778909.842683:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790778909.843125:0:8314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8314:1877767663665792:0@lo:502: 00000020:01000000:1.0:1790778909.843169:0:8314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778909.843183:0:8314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778909.843186:0:8314:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790778909.843203:0:8314:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b77208a9000 00000020:00000080:1.0:1790778909.843207:0:8314:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790778909.843255:0:8314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8314:1877767663665920:0@lo:502: 00000100:00100000:1.0:1790778909.843307:0:8314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778909.843345:0:8314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711f8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778909.843862:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663665920 00000100:00100000:2.0:1790778909.843874:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663665920 00000100:00100000:2.0:1790778909.843968:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790778909.843980:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+18:8314:x1877767663665920:12345-0@lo:502: 00000100:00100000:2.0:1790778909.844273:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+18:8314:x1877767663665920:12345-0@lo:502: Request processed in 294us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778909.844282:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790778909.844377:0:8314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8314:1877767663665920:0@lo:502: 00000020:01000000:1.0:1790778909.844409:0:8314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778909.844418:0:8314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778909.844421:0:8314:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790778909.844426:0:8314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1790778909.844755:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790778909.844783:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790778909.844796:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778909.844809:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778910.633696:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778911.336172:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778911.336205:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663666048:0@lo:41: 00000100:00100000:2.0:1790778911.336275:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778911.337824:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663666048 00000100:00100000:0.0:1790778911.337845:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663666048 00000100:00100000:0.0:1790778911.337924:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790778911.338012:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663666048:12345-0@lo:41: 00000004:00000024:0.0:1790778911.338047:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1790778911.338118:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663666048:12345-0@lo:41: Request processed in 110us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778911.338125:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790778911.338411:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663666048:0@lo:41: 00000100:00100000:2.0:1790778911.339053:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663666304:0@lo:400: 00000100:00100000:2.0:1790778911.339099:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778911.339128:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778911.339134:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663666176:0@lo:400: 00000100:00100000:2.0:1790778911.339162:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778911.339196:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663666304 00000100:00100000:2.0:1790778911.339202:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663666304 00000100:00100000:2.0:1790778911.339236:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790778911.339244:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663666304:12345-0@lo:400: 00000100:00100000:2.0:1790778911.339284:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663666304:12345-0@lo:400: Request processed in 40us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778911.339291:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790778911.339313:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663666176 00000100:00100000:2.0:1790778911.339316:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663666176 00000100:00100000:2.0:1790778911.339339:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790778911.339346:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:3652:x1877767663666176:12345-0@lo:400: 00000100:00100000:2.0:1790778911.339375:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:3652:x1877767663666176:12345-0@lo:400: Request processed in 29us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778911.339381:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790778911.339407:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663666560:0@lo:400: 00000100:00100000:2.0:1790778911.339429:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778911.339447:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790778911.339453:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663666432:0@lo:400: 00000100:00100000:2.0:1790778911.339501:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778911.339641:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663666560 00000100:00100000:2.0:1790778911.339646:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663666560 00000100:00100000:2.0:1790778911.339709:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790778911.339724:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663666560:12345-0@lo:400: 00000100:00100000:2.0:1790778911.339761:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663666560:12345-0@lo:400: Request processed in 38us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778911.339766:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1790778911.340292:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7704143480 x1877767663666560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778911.340306:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663666560:0@lo:400: 00000100:00100000:2.0:1790778911.340332:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663666176:0@lo:400: 00010000:00080000:2.0:1790778911.340342:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7704143100 x1877767663666304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778911.340351:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663666304:0@lo:400: 00000100:00100000:2.0:1790778911.340376:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663666432 00000100:00100000:2.0:1790778911.340380:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663666432 00000100:00100000:2.0:1790778911.340412:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790778911.340419:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663666432:12345-0@lo:400: 00000100:00100000:2.0:1790778911.340507:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663666432:12345-0@lo:400: Request processed in 87us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778911.340514:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790778911.341303:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663666432:0@lo:400: 00010000:00010000:3.0:1790778911.659503:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790778912.077972:0:8431:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790778912.077976:0:8431:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1790778912.077978:0:8431:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790778912.078093:0:8431:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b77344a6000 00000020:01000004:3.0:1790778912.078108:0:8431:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790778912.078119:0:8431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790778912.078143:0:8431:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b773b784d40) 00000020:00000080:3.0:1790778912.078158:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790778912.137090:0:8431:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1790778912.137146:0:8431:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1790778912.174120:0:8431:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790778912.174332:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1790778912.174344:0:8431:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790778912.174357:0:8431:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb1aa4014e936c8c3 00000020:01000004:1.0:1790778912.174363:0:8431:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1790778912.174384:0:8431:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790778912.174388:0:8431:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790778912.174395:0:8431:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1790778912.174400:0:8431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1790778912.174411:0:8431:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b77041cb380) 00000020:00000080:1.0:1790778912.174434:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1790778912.175840:0:8431:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790778912.176032:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790778912.176038:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790778912.180961:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790778912.180974:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790778912.183249:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790778912.183263:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790778912.197080:0:8431:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790778912.197280:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790778912.197287:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1790778912.201668:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1790778912.201681:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1790778912.254800:0:8431:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790778912.255308:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790778912.255316:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1790778912.259097:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790778912.259115:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790778912.263939:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790778912.263954:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1790778912.273353:0:8431:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790778912.273669:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1790778912.273676:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1790778912.275015:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1790778912.275024:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790778912.353187:0:8431:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790778912.354019:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790778912.354025:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790778912.357299:0:8431:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790778912.357326:0:8431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790778912.360591:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790778912.360628:0:8431:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1790778912.360635:0:8431:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790778912.382130:0:8431:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790778912.382170:0:8431:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790778912.382174:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790778912.382176:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790778912.382178:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778912.382179:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790778912.382181:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778912.382182:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778912.382184:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790778912.382186:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790778912.382187:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790778912.382189:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778912.382190:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790778912.382194:0:8431:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790778912.382196:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790778912.382198:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790778912.382199:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778912.382200:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790778912.382201:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778912.382202:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778912.382203:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790778912.382204:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790778912.382205:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790778912.382206:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778912.382207:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790778912.382234:0:8431:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790778912.382252:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663666688:0@lo:253: 00000100:00100000:2.0:1790778912.382325:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778912.382534:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790778912.383515:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663666688 00000100:00100000:0.0:1790778912.383525:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663666688 00000100:00100000:0.0:1790778912.383609:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790778912.383619:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+18:8431:x1877767663666688:12345-0@lo:253: 20000000:01000000:0.0:1790778912.383651:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790778912.383655:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1790778912.383660:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1790778912.383663:0:6518:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1790778912.384099:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790778912.384250:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1790778912.384268:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1790778912.384286:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1790778912.384292:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1790778912.384306:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1790778912.384320:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1790778912.384496:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1790778912.384513:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:0.0:1790778912.384521:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1790778912.384539:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1790778912.384547:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790778912.384560:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1790778912.384566:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1790778912.384577:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1790778912.384583:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1790778912.384593:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1790778912.384606:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1790778912.384672:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1790778912.384683:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:0.0:1790778912.384684:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1790778912.384703:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1790778912.384708:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790778912.384848:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1790778912.384858:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1790778912.384876:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1790778912.384915:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1790778912.384996:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1790778912.385020:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1790778912.386271:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1790778912.386297:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:0.0:1790778912.386299:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1790778912.386317:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1790778912.386323:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790778912.386336:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1790778912.386343:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1790778912.386354:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1790778912.386360:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1790778912.386457:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1790778912.386491:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1790778912.386508:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790778912.386511:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790778912.386515:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790778912.386560:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1790778912.386563:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790778912.387609:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1790778912.387644:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1790778912.387661:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1790778912.388456:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1790778912.388498:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1790778912.388516:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1790778912.388529:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790778912.388531:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790778912.394157:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1790778912.394575:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1790778912.394608:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1790778912.394623:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1790778912.394651:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790778912.394654:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790778912.397478:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1790778912.397535:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1790778912.397577:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1790778912.398081:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1790778912.398107:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1790778912.398121:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1790778912.398131:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790778912.398133:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790778912.399355:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1790778912.399441:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1790778912.399467:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1790778912.399857:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1790778912.399876:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1790778912.400107:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:1.0:1790778912.400128:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790778912.400153:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.400174:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c79d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c796 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.400183:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936c814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c80d expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.400190:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c845 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.400197:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e6e00/0xb1aa4014e936c868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c861 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.400203:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c88b expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.400228:0:6518:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.400267:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c88b expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.400281:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c892 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c88b expref: 18 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778912.400296:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663666816:0@lo:104: 00000100:00100000:1.0:1790778912.400361:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778912.400516:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e6e00/0xb1aa4014e936c868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c861 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.400525:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77089e6e00/0xb1aa4014e936c868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c861 expref: 18 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778912.400534:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663666944:0@lo:104: 00000100:00100000:1.0:1790778912.400553:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778912.400623:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c845 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.400632:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c84c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c845 expref: 18 pid: 6515 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778912.400640:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663667072:0@lo:104: 00000100:00100000:1.0:1790778912.400656:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778912.400708:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663666816 00000100:00100000:2.0:1790778912.400716:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663666816 00000100:00100000:2.0:1790778912.400756:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663666944 00000100:00100000:2.0:1790778912.400759:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663666944 00000100:00100000:2.0:1790778912.400778:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790778912.400786:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6518:x1877767663666816:12345-0@lo:104: 00010000:00010000:2.0:1790778912.400799:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c88b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778912.400847:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790778912.400852:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6518:x1877767663666816:12345-0@lo:104: Request processed in 68us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778912.400859:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790778912.400873:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790778912.400902:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6518:x1877767663666944:12345-0@lo:104: 00010000:00010000:2.0:1790778912.400909:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778912.400945:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790778912.400950:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6518:x1877767663666944:12345-0@lo:104: Request processed in 72us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778912.400963:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1790778912.401110:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790778912.401122:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c88b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401130:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663600 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790778912.401134:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c88b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401143:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778912.401150:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778912.401156:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790778912.401187:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c88b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401193:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778912.401214:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c88b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401220:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c88b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c892 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401231:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790778912.401234:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401240:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742148200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790778912.401243:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401259:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778912.401266:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778912.401271:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790778912.401282:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401287:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778912.401292:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c861 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401299:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401307:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778912.401309:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778912.401310:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778912.401316:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778912.401326:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663667328:0@lo:103: 00000100:00100000:3.0:1790778912.401352:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.401392:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790778912.401398:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663667200:0@lo:103: 00000100:00100000:3.0:1790778912.401418:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.401442:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663667328 00000100:00100000:3.0:1790778912.401457:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663667328 00010000:00010000:3.0:1790778912.401477:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e6e00/0xb1aa4014e936c868 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c861 expref: 19 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.401505:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663667200 00000100:00100000:3.0:1790778912.401509:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663667200 00010000:00010000:3.0:1790778912.401522:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c892 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c88b expref: 20 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.401538:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790778912.401544:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+20:3652:x1877767663667328:12345-0@lo:103: 00010000:00010000:3.0:1790778912.401554:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778912.401559:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e6e00/0xb1aa4014e936c868 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c861 expref: 20 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401568:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e6e00/0xb1aa4014e936c868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c861 expref: 20 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401581:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778912.401614:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+20:3652:x1877767663667328:12345-0@lo:103: Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778912.401621:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790778912.401635:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790778912.401641:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+19:3652:x1877767663667200:12345-0@lo:103: 00010000:00010000:3.0:1790778912.401647:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778912.401652:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c892 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c88b expref: 19 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401659:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c892 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c88b expref: 19 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.401667:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778912.401694:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+19:3652:x1877767663667200:12345-0@lo:103: Request processed in 55us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778912.401699:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790778912.401737:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663667200:0@lo:103: 00000100:00100000:3.0:1790778912.401745:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663667328:0@lo:103: 00010000:00010000:1.0:1790778912.404415:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936c814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c80d expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.404456:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936c814 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c80d expref: 18 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778912.404473:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663667456:0@lo:104: 00000100:00100000:1.0:1790778912.404523:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778912.404545:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c796 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.404553:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c79d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c796 expref: 18 pid: 6515 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778912.404561:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663667584:0@lo:104: 00000100:00100000:1.0:1790778912.404580:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778912.404589:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7710897cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1790778912.404609:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c892 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c88b expref: 18 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778912.404621:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663666816:0@lo:104: 00010000:00010000:1.0:1790778912.404632:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6e00/0xb1aa4014e936c868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c861 expref: 17 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778912.404640:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663666944:0@lo:104: 00000100:00100000:2.0:1790778912.404919:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663667072 00000100:00100000:2.0:1790778912.404927:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663667072 00000100:00100000:2.0:1790778912.405067:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663667456 00000100:00100000:2.0:1790778912.405071:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663667456 00000100:00100000:2.0:1790778912.405081:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663667584 00000100:00100000:2.0:1790778912.405084:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663667584 00000100:00100000:2.0:1790778912.405095:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790778912.405103:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+5:6518:x1877767663667072:12345-0@lo:104: 00010000:00010000:2.0:1790778912.405115:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b770894ac00/0xb1aa4014e936c845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778912.405179:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790778912.405185:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+5:6518:x1877767663667072:12345-0@lo:104: Request processed in 83us (4528us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778912.405192:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790778912.405207:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790778912.405213:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6518:x1877767663667456:12345-0@lo:104: 00010000:00010000:2.0:1790778912.405221:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c80d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778912.405250:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790778912.405254:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6518:x1877767663667456:12345-0@lo:104: Request processed in 42us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778912.405260:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790778912.405272:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790778912.405277:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6518:x1877767663667584:12345-0@lo:104: 00010000:00010000:2.0:1790778912.405293:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936c796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778912.405320:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790778912.405324:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6518:x1877767663667584:12345-0@lo:104: Request processed in 48us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778912.405330:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1790778912.405385:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790778912.405393:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894ac00/0xb1aa4014e936c845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405399:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ac00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790778912.405404:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894ac00/0xb1aa4014e936c845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405413:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894ac00/0xb1aa4014e936c845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778912.405420:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894ac00/0xb1aa4014e936c845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778912.405426:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790778912.405471:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894ac00/0xb1aa4014e936c845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405478:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778912.405497:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894ac00/0xb1aa4014e936c845 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405504:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894ac00/0xb1aa4014e936c845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c84c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405528:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790778912.405532:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c80d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405538:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663a00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790778912.405540:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c80d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405547:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c80d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778912.405554:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c80d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778912.405559:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790778912.405573:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c80d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405578:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778912.405583:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c80d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405589:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c80d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c814 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405598:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790778912.405601:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936c796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405617:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742148a00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790778912.405620:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936c796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405626:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936c796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778912.405632:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936c796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778912.405637:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790778912.405649:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936c796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405654:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778912.405666:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936c796 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405673:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936c796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c79d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.405688:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778912.405690:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778912.405691:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778912.405703:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663667712:0@lo:103: 00000100:00100000:3.0:1790778912.405747:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.405786:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778912.405792:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663667840:0@lo:103: 00000100:00100000:3.0:1790778912.405822:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.405852:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663667712 00000100:00100000:3.0:1790778912.405856:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663667712 00010000:00010000:3.0:1790778912.405876:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c84c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c845 expref: 17 pid: 6515 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.405926:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663667840 00000100:00100000:3.0:1790778912.406051:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663667840 00010000:00010000:3.0:1790778912.406071:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936c814 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c80d expref: 18 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.406093:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790778912.406101:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+18:3649:x1877767663667712:12345-0@lo:103: 00010000:00010000:3.0:1790778912.406112:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778912.406117:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c84c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c845 expref: 18 pid: 6515 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406126:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c84c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c845 expref: 18 pid: 6515 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406144:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778912.406173:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+18:3649:x1877767663667712:12345-0@lo:103: Request processed in 74us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778912.406180:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790778912.406196:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790778912.406202:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+17:3649:x1877767663667840:12345-0@lo:103: 00010000:00010000:3.0:1790778912.406209:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778912.406212:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936c814 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c80d expref: 17 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406231:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936c814 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c80d expref: 17 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406241:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778912.406265:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+17:3649:x1877767663667840:12345-0@lo:103: Request processed in 64us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778912.406271:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790778912.406298:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663667968:0@lo:103: 00000100:00100000:3.0:1790778912.406338:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.406379:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663667840:0@lo:103: 00000100:00100000:3.0:1790778912.406386:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663667712:0@lo:103: 00010000:00010000:3.0:1790778912.406408:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778912.406417:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663667968 00000100:00100000:3.0:1790778912.406420:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663667968 00010000:00010000:3.0:1790778912.406432:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c79d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c796 expref: 17 pid: 6515 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.406465:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790778912.406472:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+17:3651:x1877767663667968:12345-0@lo:103: 00010000:00010000:3.0:1790778912.406480:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778912.406484:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c79d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c796 expref: 17 pid: 6515 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406492:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c79d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c796 expref: 17 pid: 6515 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406504:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406519:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406535:0:7465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406541:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406548:0:7465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406554:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406560:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790778912.406564:0:7465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406572:0:7465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406581:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.406592:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778912.406621:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+17:3651:x1877767663667968:12345-0@lo:103: Request processed in 150us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778912.406628:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790778912.406675:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663667968:0@lo:103: 00010000:00010000:1.0:1790778912.407245:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c84c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c845 expref: 16 pid: 6515 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778912.407259:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663667072:0@lo:104: 00010000:00010000:1.0:1790778912.407269:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936c814 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c80d expref: 15 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778912.407286:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663667456:0@lo:104: 00010000:00010000:1.0:1790778912.407299:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c79d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c796 expref: 14 pid: 6515 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778912.407308:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663667584:0@lo:104: 00010000:00010000:1.0:1790778912.407329:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.407338:0:6518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.407344:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.407349:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790778912.407372:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790778912.413580:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+13:8431:x1877767663666688:12345-0@lo:253: Request processed in 29954us (31246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778912.413595:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790778912.413696:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663666688:0@lo:253: 10000000:01000000:2.0:1790778912.413711:0:8431:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790778912.413714:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790778912.413716:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790778912.413717:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778912.413719:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1790778912.413730:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778912.413732:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778912.413734:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790778912.413735:0:8431:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790778912.413737:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778912.413738:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790778912.413759:0:8431:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b77344a6000 from lustre-OST0000 10000000:01000000:2.0:1790778912.413797:0:8431:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790778912.413800:0:8431:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790778912.413808:0:8431:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b773059cd40 local copy 10000000:01000000:2.0:1790778912.413812:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790778912.413846:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778912.413857:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778912.413865:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778912.414087:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668096:0@lo:101: 00000100:00100000:2.0:1790778912.414126:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778912.414160:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790778912.414219:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663668096 00000100:00100000:1.0:1790778912.414225:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663668096 00000100:00100000:1.0:1790778912.414265:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790778912.414273:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+13:8431:x1877767663668096:12345-0@lo:101: 00010000:00010000:1.0:1790778912.414286:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778912.414300:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c8d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.414336:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c8d8 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.414346:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c8d8 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.414355:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b200, rc 0) 00000100:00100000:1.0:1790778912.414406:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668096:12345-0@lo:101: Request processed in 134us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778912.414412:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790778912.414777:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668096:0@lo:101: 00010000:00010000:3.0:1790778912.414792:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.414802:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.414920:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668224:0@lo:501: 00000100:00100000:3.0:1790778912.414963:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.414990:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b71cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790778912.415616:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663668224 00000100:00100000:1.0:1790778912.415623:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663668224 00000100:00100000:1.0:1790778912.417137:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790778912.417159:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668224:12345-0@lo:501: 00000100:00100000:1.0:1790778912.417281:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668224:12345-0@lo:501: Request processed in 131us (2318us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790778912.417289:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790778912.417376:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668224:0@lo:501: 10000000:01000000:3.0:1790778912.417398:0:8431:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790778912.417440:0:8431:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790778912.417457:0:8431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.417475:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.417483:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.417506:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790778912.417556:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b77344a6000 10000000:01000000:3.0:1790778912.417561:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790778912.417566:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790778912.417569:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790778912.417574:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790778912.417589:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790778912.417614:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.417622:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.417632:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.417660:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668352:0@lo:101: 00000100:00100000:3.0:1790778912.417714:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778912.417781:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778912.417789:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.417798:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e6400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790778912.417802:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.417811:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778912.417818:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778912.417824:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778912.417845:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.417852:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778912.417872:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.417894:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936c8d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1aa4014e936c8df expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.417917:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778912.417919:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778912.417921:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778912.417944:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663668480:0@lo:103: 00000100:00100000:0.0:1790778912.417978:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778912.418033:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663668480 00000100:00100000:0.0:1790778912.418040:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663668480 00000100:00100000:0.0:1790778912.418079:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778912.418087:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+14:3652:x1877767663668480:12345-0@lo:103: 00010000:00010000:0.0:1790778912.418098:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778912.418111:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c8df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936c8d8 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.418126:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778912.418158:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+13:3652:x1877767663668480:12345-0@lo:103: Request processed in 71us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778912.418165:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778912.418193:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663668480:0@lo:103: 00000100:00100000:3.0:1790778912.422960:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b71c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778912.423244:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663668352 00000100:00100000:2.0:1790778912.423253:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663668352 00000100:00100000:2.0:1790778912.423309:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790778912.423319:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+13:8431:x1877767663668352:12345-0@lo:101: 00010000:00010000:2.0:1790778912.423337:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778912.423358:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936c8ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c8e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778912.423397:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936c8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c8e6 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778912.423409:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936c8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c8e6 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778912.423418:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e7600, rc 0) 00000100:00100000:2.0:1790778912.423502:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668352:12345-0@lo:101: Request processed in 185us (5788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778912.423510:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790778912.424526:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668352:0@lo:101: 00010000:00010000:3.0:1790778912.424549:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.424560:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.424669:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668608:0@lo:501: 00000100:00100000:3.0:1790778912.424713:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.424759:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b71c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778912.424949:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663668608 00000100:00100000:2.0:1790778912.424955:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663668608 00000100:00100000:2.0:1790778912.424988:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790778912.424996:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668608:12345-0@lo:501: 00000100:00100000:2.0:1790778912.425109:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668608:12345-0@lo:501: Request processed in 114us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778912.425133:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790778912.425625:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668608:0@lo:501: 00000100:00100000:3.0:1790778912.425659:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668736:0@lo:503: 00000100:00100000:3.0:1790778912.425700:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.425738:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b71c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778912.425917:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663668736 00000100:00100000:2.0:1790778912.425923:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663668736 00000100:00100000:3.0:1790778912.426301:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790778912.426319:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668736:12345-0@lo:503: 00000100:00100000:3.0:1790778912.426545:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668736:12345-0@lo:503: Request processed in 227us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778912.426553:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790778912.426637:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668736:0@lo:503: 00000040:00080000:2.0:1790778912.427140:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790778912.427227:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668864:0@lo:502: 00000100:00100000:2.0:1790778912.427273:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778912.427306:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71180 going to sleep for 11 seconds 00000100:00100000:0.0:1790778912.427458:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663668864 00000100:00100000:0.0:1790778912.427463:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663668864 00000100:00100000:0.0:1790778912.427548:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790778912.427557:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668864:12345-0@lo:502: 00000100:00100000:0.0:1790778912.427660:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668864:12345-0@lo:502: Request processed in 105us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778912.427668:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790778912.427748:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668864:0@lo:502: 00000040:00080000:2.0:1790778912.428400:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790778912.428432:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790778912.428458:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1790778912.428476:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1790778912.428491:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1790778912.428504:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1790778912.428529:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668992:0@lo:502: 00000100:00100000:2.0:1790778912.428573:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778912.429257:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663668992 00000100:00100000:1.0:1790778912.429264:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663668992 00000100:00100000:1.0:1790778912.429297:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790778912.429305:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668992:12345-0@lo:502: 00000100:00100000:1.0:1790778912.429417:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663668992:12345-0@lo:502: Request processed in 112us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778912.429424:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790778912.429580:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71180 going to sleep for 11 seconds 00000100:00100000:3.0:1790778912.429601:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663668992:0@lo:502: 00000040:00080000:3.0:1790778912.429660:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790778912.429671:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1790778912.430537:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790778912.430547:0:8454:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1790778912.430554:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778912.430556:0:8454:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790778912.430562:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790778912.430578:0:8454:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b773b780000) 00000020:00000080:3.0:1790778912.430598:0:8454:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790778912.430605:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790778912.430676:0:8454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b77344a6000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790778912.430684:0:8454:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790778912.430689:0:8454:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb1aa4014e936c8fb 00010000:00010000:3.0:1790778912.439319:0:8454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1790778912.439635:0:8454:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1790778912.445793:0:8454:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790778912.446196:0:8454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1790778912.459835:0:8454:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1790778912.463316:0:8454:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1790778912.482857:0:8454:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1790778912.493170:0:8454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790778912.493184:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778912.493194:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778912.493206:0:8454:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790778912.493211:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778912.493215:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778912.493216:0:8454:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790778912.493219:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790778912.493221:0:8454:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790778912.493256:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778912.493259:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778912.493261:0:8454:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790778912.493264:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790778912.495679:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1790778912.495733:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790778912.495761:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.495775:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778912.495792:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b77344a6000 from 1 10000000:01000000:3.0:1790778912.495795:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790778912.495832:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.495840:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.495852:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.495876:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669120:0@lo:101: 00000100:00100000:3.0:1790778912.496077:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.496128:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b3300 going to sleep for 11 seconds 00000100:00100000:1.0:1790778912.496631:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663669120 00000100:00100000:1.0:1790778912.496641:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663669120 00000100:00100000:1.0:1790778912.496687:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790778912.496697:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+14:8431:x1877767663669120:12345-0@lo:101: 00010000:00010000:1.0:1790778912.496710:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778912.496724:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894be00/0xb1aa4014e936c909 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c902 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.496758:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894be00/0xb1aa4014e936c909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c902 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.496771:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894be00/0xb1aa4014e936c909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c902 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778912.496780:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894be00, rc 0) 00000100:00100000:1.0:1790778912.496840:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:8431:x1877767663669120:12345-0@lo:101: Request processed in 145us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778912.496847:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790778912.498876:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669120:0@lo:101: 00010000:00010000:3.0:1790778912.498942:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.498955:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.499067:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669248:0@lo:501: 00000100:00100000:3.0:1790778912.499121:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.499157:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1790778912.500271:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663669248 00000100:00100000:0.0:1790778912.500282:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663669248 00000100:00100000:0.0:1790778912.500338:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790778912.500347:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:8431:x1877767663669248:12345-0@lo:501: 00000100:00100000:0.0:1790778912.501156:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:8431:x1877767663669248:12345-0@lo:501: Request processed in 808us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778912.501165:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790778912.501484:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669248:0@lo:501: 00000100:00100000:3.0:1790778912.501528:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669376:0@lo:503: 00000100:00100000:3.0:1790778912.501590:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.501626:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1790778912.502514:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663669376 00000100:00100000:0.0:1790778912.502523:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663669376 00000100:00100000:0.0:1790778912.502561:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790778912.502569:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:8431:x1877767663669376:12345-0@lo:503: 00000100:00100000:0.0:1790778912.502694:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:8431:x1877767663669376:12345-0@lo:503: Request processed in 125us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778912.502702:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790778912.505650:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669376:0@lo:503: 00000040:00080000:2.0:1790778912.506646:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790778912.507157:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669504:0@lo:502: 00000100:00100000:2.0:1790778912.507224:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778912.507300:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71600 going to sleep for 11 seconds 00000100:00100000:1.0:1790778912.509831:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663669504 00000100:00100000:1.0:1790778912.509841:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663669504 00000100:00100000:0.0:1790778912.510069:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790778912.510082:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:8431:x1877767663669504:12345-0@lo:502: 00000100:00100000:0.0:1790778912.510287:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:8431:x1877767663669504:12345-0@lo:502: Request processed in 209us (3062us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778912.510295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790778912.510583:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669504:0@lo:502: 00000040:00080000:2.0:1790778912.510874:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790778912.511280:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790778912.511315:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669632:0@lo:502: 00000100:00100000:2.0:1790778912.511758:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778912.511798:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71600 going to sleep for 11 seconds 00000100:00100000:0.0:1790778912.511862:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663669632 00000100:00100000:0.0:1790778912.511868:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663669632 00000100:00100000:0.0:1790778912.511947:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790778912.511956:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:8431:x1877767663669632:12345-0@lo:502: 00000100:00100000:0.0:1790778912.512057:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:8431:x1877767663669632:12345-0@lo:502: Request processed in 101us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778912.512065:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790778912.512348:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669632:0@lo:502: 00000040:00080000:3.0:1790778912.512430:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790778912.512443:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1790778912.513692:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790778912.513704:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778912.513706:0:8458:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790778912.513713:0:8458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b77344a6000 00000020:00000080:2.0:1790778912.513716:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790778912.513740:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778912.513743:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778912.513745:0:8458:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790778912.513748:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790778912.513901:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790778912.513925:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790778912.513951:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.513964:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778912.514010:0:8431:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790778912.514013:0:8431:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b77344a6000 10000000:01000000:3.0:1790778912.514016:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b77344a6000 10000000:01000000:3.0:1790778912.514020:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790778912.514026:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b77344a6000 from 1 10000000:01000000:3.0:1790778912.514028:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790778912.514061:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.514070:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.514081:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.514104:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669760:0@lo:101: 00000100:00100000:3.0:1790778912.514164:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.514215:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1790778912.515900:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663669760 00000100:00100000:0.0:1790778912.515912:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663669760 00000100:00100000:0.0:1790778912.515979:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790778912.515988:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:8431:x1877767663669760:12345-0@lo:101: 00010000:00010000:0.0:1790778912.516005:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778912.516021:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7742148000/0xb1aa4014e936c917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c910 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.516047:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7742148000/0xb1aa4014e936c917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c910 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.516059:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7742148000/0xb1aa4014e936c917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c910 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.516068:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742148000, rc 0) 00000100:00100000:0.0:1790778912.516134:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:8431:x1877767663669760:12345-0@lo:101: Request processed in 147us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778912.516140:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790778912.516798:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669760:0@lo:101: 00010000:00010000:3.0:1790778912.516821:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.516831:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.516973:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669888:0@lo:501: 00000100:00100000:3.0:1790778912.517008:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.517033:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b3300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778912.517053:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663669888 00000100:00100000:3.0:1790778912.517057:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663669888 00000100:00100000:3.0:1790778912.517089:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790778912.517097:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:8431:x1877767663669888:12345-0@lo:501: 00000100:00100000:3.0:1790778912.517199:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:8431:x1877767663669888:12345-0@lo:501: Request processed in 102us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778912.517207:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790778912.517243:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663669888:0@lo:501: 00000100:00100000:3.0:1790778912.517269:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663670016:0@lo:503: 00000100:00100000:3.0:1790778912.517329:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.517344:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b3300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778912.517356:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663670016 00000100:00100000:3.0:1790778912.517360:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663670016 00000100:00100000:3.0:1790778912.517391:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790778912.517397:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:8431:x1877767663670016:12345-0@lo:503: 00000100:00100000:3.0:1790778912.518630:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:8431:x1877767663670016:12345-0@lo:503: Request processed in 1227us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778912.518647:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790778912.518708:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663670016:0@lo:503: 00000040:00080000:3.0:1790778912.520234:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790778912.520344:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663670144:0@lo:502: 00000100:00100000:3.0:1790778912.521683:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.521782:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711c36f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790778912.524911:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663670144 00000100:00100000:0.0:1790778912.524925:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663670144 00000100:00100000:0.0:1790778912.525169:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790778912.525179:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:8431:x1877767663670144:12345-0@lo:502: 00000100:00100000:0.0:1790778912.525441:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:8431:x1877767663670144:12345-0@lo:502: Request processed in 263us (3761us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778912.525458:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790778912.526522:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663670144:0@lo:502: 00000040:00080000:0.0:1790778912.530343:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790778912.530426:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790778912.530459:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790778912.530477:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790778912.530505:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790778912.530520:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790778912.530533:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790778912.530545:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790778912.530557:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790778912.530578:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790778912.530590:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790778912.530602:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790778912.530614:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790778912.530638:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790778912.530652:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790778912.530663:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790778912.530675:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790778912.530686:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790778912.530713:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790778912.531390:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790778912.531410:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790778912.531442:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790778912.531467:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790778912.531482:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790778912.531496:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1790778912.531510:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1790778912.531522:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1790778912.531535:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1790778912.531547:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1790778912.531559:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1790778912.531569:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1790778912.531583:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1790778912.531596:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1790778912.531610:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1790778912.531643:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1790778912.531659:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1790778912.531673:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1790778912.531741:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663670272:0@lo:502: 00000100:00100000:0.0:1790778912.531822:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778912.531858:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720bd6600 going to sleep for 11 seconds 00000100:00100000:1.0:1790778912.531977:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663670272 00000100:00100000:1.0:1790778912.531986:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663670272 00000100:00100000:1.0:1790778912.532037:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790778912.532046:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:8431:x1877767663670272:12345-0@lo:502: 00000100:00100000:1.0:1790778912.532196:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:8431:x1877767663670272:12345-0@lo:502: Request processed in 151us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778912.532204:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790778912.533429:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663670272:0@lo:502: 00000040:00080000:3.0:1790778912.533522:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1790778912.533534:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1790778912.534592:0:8459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790778912.534608:0:8459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b77041ccd40) 00000020:00000080:1.0:1790778912.534628:0:8459:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1790778912.534701:0:8459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b77344a6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790778912.534706:0:8459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b77344a6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790778912.534708:0:8459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b77344a6000 3 00010000:00080000:1.0:1790778912.534746:0:8459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7601dee800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1790778912.539409:0:8459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1790778912.539610:0:8459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790778912.539651:0:8459:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790778912.539664:0:8459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb1aa4014e936c925 00000100:00080000:0.0:1790778912.539674:0:8459:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790778912.539684:0:8459:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b7601dee800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790778912.539719:0:8459:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b77041af480 x1877767663670400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790778912.539745:0:8459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790778912.541636:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663670400:0@lo:38: 00000100:00100000:2.0:1790778912.541708:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778912.541836:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663670784:0@lo:400: 00000100:00100000:2.0:1790778912.541860:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778912.541896:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790778912.541902:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663670912:0@lo:400: 00000100:00100000:2.0:1790778912.541928:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778912.541962:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663670400 00000100:00100000:2.0:1790778912.541969:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663670400 00000100:00100000:2.0:1790778912.541995:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663670784 00000100:00100000:2.0:1790778912.541998:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663670784 00000100:00100000:2.0:1790778912.542034:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790778912.542042:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663670784:12345-0@lo:400: 00000100:00100000:2.0:1790778912.542091:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663670784:12345-0@lo:400: Request processed in 50us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778912.542099:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790778912.542114:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790778912.542118:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1877767663670400:12345-0@lo:38: 00010000:00080000:2.0:1790778912.542143:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:2.0:1790778912.542175:0:6524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb1aa4014e936c92c 00000004:00100000:2.0:1790778912.542190:0:6524:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790778912.542221:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9b7601dcb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778912.542315:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663670528:0@lo:400: 00000100:00100000:3.0:1790778912.542354:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.542371:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778912.542376:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663670656:0@lo:400: 00000100:00100000:3.0:1790778912.542393:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.542423:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663670912 00000100:00100000:3.0:1790778912.542427:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663670912 00000100:00100000:3.0:1790778912.542459:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663670656 00000100:00100000:3.0:1790778912.542462:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663670656 00000100:00100000:2.0:1790778912.542476:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877767663670400:12345-0@lo:38: Request processed in 354us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778912.542481:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790778912.542487:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790778912.542492:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663670912:12345-0@lo:400: 00000100:00100000:2.0:1790778912.542504:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663670528 00000100:00100000:2.0:1790778912.542509:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663670528 00000100:00100000:3.0:1790778912.542535:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663670912:12345-0@lo:400: Request processed in 45us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778912.542535:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790778912.542547:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790778912.542548:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663670528:12345-0@lo:400: 00000100:00100000:3.0:1790778912.542565:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790778912.542573:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663670656:12345-0@lo:400: 00000100:00100000:2.0:1790778912.542595:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663670528:12345-0@lo:400: Request processed in 48us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778912.542601:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790778912.542636:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663670912:0@lo:400: 00010000:00080000:2.0:1790778912.542648:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7704141c00 x1877767663670784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778912.542657:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663670784:0@lo:400: 00010000:00080000:2.0:1790778912.542685:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b77041af480 x1877767663670400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790778922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778912.542692:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790778912.542699:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1790778912.542707:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:3.0:1790778912.542712:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663670656:12345-0@lo:400: Request processed in 138us (315us total) trans 0 rc 0/0 00000100:00080000:2.0:1790778912.542712:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790778912.542716:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7601dee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790778912.542730:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790778912.542733:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663670400:0@lo:38: 00000100:00100000:3.0:1790778912.542767:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663670656:0@lo:400: 00010000:00080000:3.0:1790778912.542779:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7704143800 x1877767663670528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778912.542788:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663670528:0@lo:400: 00000020:01000004:0.0:1790778912.542962:0:8459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790778912.542977:0:8459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9b7735a699c0) 00000020:00000080:0.0:1790778912.542994:0:8459:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1790778912.543067:0:8459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b77344a6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790778912.543071:0:8459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b77344a6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790778912.543074:0:8459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b77344a6000 3 00010000:00080000:0.0:1790778912.543098:0:8459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b77342fd800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1790778912.546830:0:8459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1790778912.547302:0:8459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1790778912.547350:0:8459:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790778912.547365:0:8459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb1aa4014e936c93a 00000100:00080000:0.0:1790778912.547377:0:8459:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790778912.547390:0:8459:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9b77342fd800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790778912.547439:0:8459:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b77041afb80 x1877767663671040/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790778912.547475:0:8459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790778912.547688:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1877767663671040:0@lo:38: 00000100:00100000:1.0:1790778912.547761:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778912.547826:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663671040 00000100:00100000:1.0:1790778912.547834:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663671040 00000100:00100000:1.0:1790778912.547863:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790778912.547870:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1877767663671040:12345-0@lo:38: 00010000:00080000:1.0:1790778912.547911:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1790778912.547955:0:6524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb1aa4014e936c941 00000004:00100000:1.0:1790778912.547971:0:6524:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790778912.548002:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9b7601dea000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790778912.548052:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877767663671040:12345-0@lo:38: Request processed in 181us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778912.548060:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790778912.548106:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b77041afb80 x1877767663671040/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790778922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778912.548116:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790778912.548123:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1790778912.548129:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790778912.548133:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790778912.548135:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77342fd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790778912.548141:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1877767663671040:0@lo:38: 00000040:00080000:1.0:1790778912.549157:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1790778912.549495:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1790778912.549527:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790778912.549551:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.549563:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790778912.549610:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790778912.549612:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790778912.549614:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790778912.549615:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790778912.549616:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790778912.549618:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790778912.549620:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790778912.549621:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790778912.549623:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790778912.549625:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790778912.549627:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790778912.549630:0:8431:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1790778912.549633:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790778912.549634:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790778912.549636:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790778912.549637:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790778912.549638:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790778912.549639:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790778912.549640:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790778912.549647:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790778912.549648:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790778912.549650:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790778912.549650:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790778912.549670:0:8431:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790778912.549685:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663671168:0@lo:253: 00000100:00100000:3.0:1790778912.549749:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.549788:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711c36f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790778912.549870:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663671168 00000100:00100000:0.0:1790778912.549876:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663671168 00000100:00100000:0.0:1790778912.549958:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790778912.549968:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:8431:x1877767663671168:12345-0@lo:253: 20000000:01000000:0.0:1790778912.549995:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790778912.550008:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790778912.568606:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790778912.568671:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790778912.569553:0:6539:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790778912.569560:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1790778912.569777:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:8431:x1877767663671168:12345-0@lo:253: Request processed in 19806us (20023us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778912.569789:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790778912.569942:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:8431:1877767663671168:0@lo:253: 10000000:01000000:1.0:1790778912.569956:0:8431:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790778912.569960:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790778912.569962:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790778912.569963:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790778912.569965:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790778912.569966:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790778912.569967:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790778912.569969:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790778912.569970:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790778912.569972:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790778912.569973:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790778912.569975:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790778912.569988:0:8431:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1790778912.573936:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.573960:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c837 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.573968:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701662c00/0xb1aa4014e936c85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c853 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.573976:0:6539:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.574016:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701662c00/0xb1aa4014e936c85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c853 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.574032:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7701662c00/0xb1aa4014e936c85a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c853 expref: 15 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.574047:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff32a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663671296:0@lo:104: 00000100:00100000:3.0:1790778912.574112:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790778912.574163:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c837 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.574190:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c83e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c837 expref: 15 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.574199:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663671424:0@lo:104: 00000100:00100000:3.0:1790778912.574220:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720bd6600 going to sleep for 11 seconds 00000100:00100000:3.0:1790778912.574504:0:6507:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790778912.574524:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.574586:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663671296 00000100:00100000:3.0:1790778912.574593:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663671296 00080000:10000000:1.0:1790778912.575171:0:8431:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1790778912.575971:0:8431:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1790778912.576181:0:8431:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1790778912.576642:0:8431:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1790778912.576919:0:8431:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1790778912.577089:0:8431:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1790778912.577289:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663671424 00000100:00100000:0.0:1790778912.577298:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663671424 00000100:00100000:0.0:1790778912.577335:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790778912.577345:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b505850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+4:6539:x1877767663671296:12345-0@lo:104: 00010000:00010000:0.0:1790778912.577361:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.577694:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790778912.577700:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b505850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+4:6539:x1877767663671296:12345-0@lo:104: Request processed in 358us (3589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778912.577708:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790778912.577748:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790778912.577756:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:6539:x1877767663671424:12345-0@lo:104: 00010000:00010000:0.0:1790778912.577765:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.577797:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790778912.577802:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:6539:x1877767663671424:12345-0@lo:104: Request processed in 48us (3279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778912.577819:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1790778912.577838:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790778912.577846:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.577852:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790778912.577857:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.577865:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778912.577871:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778912.577900:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778912.577935:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.577942:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778912.577958:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c853 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.577965:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c85a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.577977:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778912.577980:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.577998:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b600 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790778912.578000:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.578007:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778912.578013:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778912.578018:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778912.578032:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.578038:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778912.578043:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c837 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.578049:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c83e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778912.578064:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778912.578066:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778912.578068:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778912.578674:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff32a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663671296:0@lo:104: 00000100:00100000:3.0:1790778912.578684:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663671424:0@lo:104: 00010000:00010000:3.0:1790778912.578706:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.578722:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778912.578733:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663671552:0@lo:103: 00000100:00100000:3.0:1790778912.578771:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.578811:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778912.578817:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663671680:0@lo:103: 00000100:00100000:3.0:1790778912.578838:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778912.578897:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663671552 00000100:00100000:3.0:1790778912.578902:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663671552 00010000:00010000:3.0:1790778912.578924:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701662c00/0xb1aa4014e936c85a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c853 expref: 16 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.578945:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663671680 00000100:00100000:3.0:1790778912.578949:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663671680 00010000:00010000:3.0:1790778912.578969:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c83e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c837 expref: 17 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778912.578989:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790778912.578997:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+17:3649:x1877767663671552:12345-0@lo:103: 00010000:00010000:3.0:1790778912.579007:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778912.579012:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701662c00/0xb1aa4014e936c85a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c853 expref: 17 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579022:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701662c00/0xb1aa4014e936c85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c853 expref: 17 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579036:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662c00/0xb1aa4014e936c85a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c853 expref: 17 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579048:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778912.579079:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+16:3649:x1877767663671552:12345-0@lo:103: Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778912.579085:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790778912.579100:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790778912.579105:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+15:3649:x1877767663671680:12345-0@lo:103: 00010000:00010000:3.0:1790778912.579113:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778912.579116:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c83e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c837 expref: 15 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579124:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c837 expref: 15 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579133:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c83e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c837 expref: 15 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579156:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579163:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790778912.579176:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013751976s 00010000:00010000:3.0:1790778912.579182:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579188:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579196:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579203:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579210:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790778912.579214:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579222:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579248:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579265:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778912.579296:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+14:3649:x1877767663671680:12345-0@lo:103: Request processed in 190us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778912.579303:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790778912.579333:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663671680:0@lo:103: 00000100:00100000:3.0:1790778912.579342:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663671552:0@lo:103: 00010000:00010000:3.0:1790778912.579359:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579528:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778912.579534:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c948 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1790778912.580840:0:8431:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790778912.589958:0:8431:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790778912.589968:0:8431:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790778912.590007:0:8431:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790778912.590051:0:8431:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790778912.590070:0:8431:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790778912.590090:0:8431:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1790778912.591764:0:8431:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790778912.591974:0:8431:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1790778912.684352:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778913.384035:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663671808:0@lo:41: 00000100:00100000:2.0:1790778913.384100:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778913.384530:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663671808 00000100:00100000:3.0:1790778913.384538:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663671808 00000100:00100000:3.0:1790778913.384599:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790778913.384608:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663671808:12345-0@lo:41: 00000004:00000024:3.0:1790778913.384638:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1790778913.384768:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663671808:12345-0@lo:41: Request processed in 160us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778913.384786:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790778913.388848:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663671808:0@lo:41: 00000020:00000004:0.0:1790778913.575854:0:8515:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790778913.576127:0:8515:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790778913.708539:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778914.736331:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778915.756486:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778916.456140:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778916.456182:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663671936:0@lo:41: 00000100:00100000:3.0:1790778916.456245:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778916.456319:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663671936 00000100:00100000:3.0:1790778916.456327:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663671936 00000100:00100000:3.0:1790778916.456365:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790778916.456385:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663671936:12345-0@lo:41: 00000004:00000024:3.0:1790778916.456435:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1790778916.456491:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663671936:12345-0@lo:41: Request processed in 118us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778916.456498:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790778916.456544:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663671936:0@lo:41: 00010000:00010000:3.0:1790778916.776844:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778917.800077:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778917.996995:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663672064:0@lo:400: 00000100:00100000:3.0:1790778917.997069:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778917.997126:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663672576:0@lo:400: 00000100:00100000:3.0:1790778917.997156:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778917.997186:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790778917.997192:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663672192:0@lo:400: 00000100:00100000:3.0:1790778917.997266:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778917.997286:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663672704:0@lo:400: 00000100:00100000:3.0:1790778917.997311:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778917.997341:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663672320:0@lo:400: 00000100:00100000:3.0:1790778917.997365:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778917.997391:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663672832:0@lo:400: 00000100:00100000:3.0:1790778917.997425:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778917.997444:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778917.997450:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663672448:0@lo:400: 00000100:00100000:3.0:1790778917.997470:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778917.997495:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663672064 00000100:00100000:3.0:1790778917.997502:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663672064 00000100:00100000:3.0:1790778917.997540:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790778917.997547:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+14:3649:x1877767663672064:12345-0@lo:400: 00000100:00100000:3.0:1790778917.997588:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+14:3649:x1877767663672064:12345-0@lo:400: Request processed in 42us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778917.997594:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790778917.997620:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663672576 00000100:00100000:3.0:1790778917.997623:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663672576 00000100:00100000:3.0:1790778917.997636:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663672320 00000100:00100000:3.0:1790778917.997638:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663672320 00000100:00100000:3.0:1790778917.997648:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790778917.997654:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663672576:12345-0@lo:400: 00000100:00100000:3.0:1790778917.997681:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663672576:12345-0@lo:400: Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778917.997687:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790778917.997697:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790778917.997702:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663672320:12345-0@lo:400: 00000100:00100000:3.0:1790778917.997744:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663672320:12345-0@lo:400: Request processed in 29us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778917.997750:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790778917.997770:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663672192 00000100:00100000:3.0:1790778917.997780:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663672192 00000100:00100000:3.0:1790778917.997799:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663672704 00000100:00100000:3.0:1790778917.997801:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663672704 00000100:00100000:3.0:1790778917.997822:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663672832 00000100:00100000:3.0:1790778917.997825:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663672832 00000100:00100000:3.0:1790778917.997837:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663672448 00000100:00100000:3.0:1790778917.997839:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663672448 00000100:00100000:3.0:1790778917.997850:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790778917.997855:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663672192:12345-0@lo:400: 00000100:00100000:3.0:1790778917.997909:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663672192:12345-0@lo:400: Request processed in 53us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778917.997915:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790778917.997927:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790778917.997933:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663672704:12345-0@lo:400: 00000100:00100000:3.0:1790778917.997959:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663672704:12345-0@lo:400: Request processed in 27us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778917.997965:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790778917.997976:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790778917.997981:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663672832:12345-0@lo:400: 00000100:00100000:3.0:1790778917.998022:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663672832:12345-0@lo:400: Request processed in 41us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778917.998028:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790778917.998038:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790778917.998044:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663672448:12345-0@lo:400: 00000100:00100000:3.0:1790778917.998069:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663672448:12345-0@lo:400: Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778917.998075:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1790778917.998104:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790778917.998113:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790778917.998141:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b772ff33100 x1877767663672448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778917.998154:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663672448:0@lo:400: 00000100:00100000:3.0:1790778917.998163:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663672320:0@lo:400: 00010000:00080000:3.0:1790778917.998172:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603008e00 x1877767663672832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778917.998181:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663672832:0@lo:400: 00010000:00080000:3.0:1790778917.998209:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b772ff30e00 x1877767663672192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778917.998218:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663672192:0@lo:400: 00010000:00080000:3.0:1790778917.998227:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b772ff31f80 x1877767663672704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778917.998234:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663672704:0@lo:400: 00000100:00100000:3.0:1790778917.998241:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663672064:0@lo:400: 00000100:00100000:3.0:1790778917.998248:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663672576:0@lo:400: 00000100:00100000:0.0:1790778918.505745:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663672960:0@lo:41: 00000100:00100000:0.0:1790778918.505866:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778918.505961:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663672960 00000100:00100000:0.0:1790778918.505969:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663672960 00000100:00100000:0.0:1790778918.506015:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790778918.506024:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663672960:12345-0@lo:41: 00000004:00000024:0.0:1790778918.506061:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1790778918.506123:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663672960:12345-0@lo:41: Request processed in 99us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778918.506130:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790778918.506172:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663672960:0@lo:41: 00010000:00010000:3.0:1790778918.824304:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790778918.827214:0:8804:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1790778919.528021:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790778919.528033:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b7712708000 from 30 10000000:01000000:0.0:1790778919.528039:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790778919.528095:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778919.528108:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778919.528119:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778919.528144:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673088:0@lo:101: 00000100:00100000:0.0:1790778919.528221:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778919.528291:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328180 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.528310:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663673088 00000100:00100000:3.0:1790778919.528327:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663673088 00000100:00100000:3.0:1790778919.528485:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790778919.528497:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+14:6520:x1877767663673088:12345-0@lo:101: 00010000:00010000:3.0:1790778919.528527:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778919.528548:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c94f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.528619:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c94f expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.528631:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c94f expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.528642:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662000, rc 0) 00000100:00100000:3.0:1790778919.528745:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663673088:12345-0@lo:101: Request processed in 250us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.528772:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790778919.528795:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673088:0@lo:101: 00010000:00010000:1.0:1790778919.528816:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.528827:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778919.528939:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673216:0@lo:501: 00000100:00100000:1.0:1790778919.528988:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778919.532835:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707ea0900 going to sleep for 11 seconds 00000100:00100000:0.0:1790778919.532876:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663673216 00000100:00100000:0.0:1790778919.532929:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663673216 00000100:00100000:0.0:1790778919.536980:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790778919.537016:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663673216:12345-0@lo:501: 00000100:00100000:0.0:1790778919.537290:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663673216:12345-0@lo:501: Request processed in 292us (8299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778919.537319:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790778919.537339:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673216:0@lo:501: 00000100:00100000:1.0:1790778919.538267:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673344:0@lo:503: 00000100:00100000:1.0:1790778919.538437:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778919.538484:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707ea0900 going to sleep for 11 seconds 00000100:00100000:2.0:1790778919.539317:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663673344 00000100:00100000:2.0:1790778919.539328:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663673344 00000100:00100000:2.0:1790778919.539474:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790778919.539488:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663673344:12345-0@lo:503: 00000100:00100000:2.0:1790778919.539646:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663673344:12345-0@lo:503: Request processed in 161us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778919.539654:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790778919.542048:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673344:0@lo:503: 00000100:00100000:3.0:1790778919.544318:0:8838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8838:1877767663673472:0@lo:502: 00000100:00100000:3.0:1790778919.544422:0:8838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.544468:0:8838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778919.546487:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663673472 00000100:00100000:0.0:1790778919.546511:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663673472 00000100:00100000:0.0:1790778919.546604:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790778919.546617:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:8838:x1877767663673472:12345-0@lo:502: 00000100:00100000:0.0:1790778919.546865:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:8838:x1877767663673472:12345-0@lo:502: Request processed in 250us (2441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778919.546873:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790778919.547229:0:8838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8838:1877767663673472:0@lo:502: 00000100:00100000:3.0:1790778919.547313:0:8838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8838:1877767663673600:0@lo:502: 00000100:00100000:3.0:1790778919.547391:0:8838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.547446:0:8838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778919.547528:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663673600 00000100:00100000:1.0:1790778919.547535:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663673600 00000100:00100000:1.0:1790778919.547582:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790778919.547591:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:8838:x1877767663673600:12345-0@lo:502: 00000100:00100000:1.0:1790778919.547704:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:8838:x1877767663673600:12345-0@lo:502: Request processed in 114us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778919.547712:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790778919.548216:0:8838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8838:1877767663673600:0@lo:502: 00000040:00080000:3.0:1790778919.548240:0:8838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790778919.552089:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1790778919.552133:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790778919.552146:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.552175:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778919.552187:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790778919.552190:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7712708000 from 5 10000000:01000000:1.0:1790778919.552193:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790778919.552232:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.552241:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.552252:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778919.552275:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673728:0@lo:101: 00000100:00100000:1.0:1790778919.552341:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.553193:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663673728 00000100:00100000:3.0:1790778919.553211:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663673728 00000100:00100000:3.0:1790778919.553283:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790778919.553295:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663673728:12345-0@lo:101: 00010000:00010000:3.0:1790778919.553316:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778919.553339:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c95d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.553417:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c95d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.553431:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c95d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.553442:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662a00, rc 0) 00000100:00100000:3.0:1790778919.553696:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663673728:12345-0@lo:101: Request processed in 402us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.553757:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790778919.554109:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707ea0480 going to sleep for 11 seconds 00000100:00100000:1.0:1790778919.554147:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673728:0@lo:101: 00010000:00010000:1.0:1790778919.554178:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.554191:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778919.554275:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673856:0@lo:256: 00000100:00100000:1.0:1790778919.554333:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778919.554446:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707ea0480 going to sleep for 11 seconds 00000100:00100000:2.0:1790778919.557191:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663673856 00000100:00100000:2.0:1790778919.557215:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663673856 00000100:00100000:2.0:1790778919.557308:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790778919.557322:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663673856:12345-0@lo:256: 20000000:01000000:2.0:1790778919.557359:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790778919.557414:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790778919.557418:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1790778919.557618:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663673856:12345-0@lo:256: Request processed in 299us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778919.557627:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790778919.557685:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673856:0@lo:256: 10000000:01000000:1.0:1790778919.557762:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790778919.557772:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.557783:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778919.557792:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1790778919.557795:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1790778919.557798:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790778919.557833:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.557840:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.558015:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778919.558035:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673984:0@lo:101: 00000100:00100000:1.0:1790778919.558091:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778919.558132:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707ea0480 going to sleep for 11 seconds 00000100:00100000:1.0:1790778919.558153:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663673984 00000100:00100000:1.0:1790778919.558160:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663673984 00000100:00100000:1.0:1790778919.558213:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790778919.558224:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663673984:12345-0@lo:101: 00010000:00010000:1.0:1790778919.558239:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778919.558260:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c96b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.558284:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c96b expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.558296:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c96b expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.558304:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b200, rc 0) 00000100:00100000:1.0:1790778919.558340:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663673984:12345-0@lo:101: Request processed in 119us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778919.558347:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790778919.558555:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663673984:0@lo:101: 00010000:00010000:2.0:1790778919.558589:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778919.558603:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778919.560069:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663674112:0@lo:501: 00000100:00100000:2.0:1790778919.560150:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778919.560210:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720163600 going to sleep for 11 seconds 00000100:00100000:0.0:1790778919.562972:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663674112 00000100:00100000:0.0:1790778919.562994:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663674112 00000100:00100000:0.0:1790778919.563084:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790778919.563097:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663674112:12345-0@lo:501: 00000100:00100000:0.0:1790778919.563352:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663674112:12345-0@lo:501: Request processed in 256us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778919.563372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790778919.563490:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663674112:0@lo:501: 00000100:00100000:1.0:1790778919.563560:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663674240:0@lo:503: 00000100:00100000:1.0:1790778919.563647:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778919.563688:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707ea0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778919.565368:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663674240 00000100:00100000:0.0:1790778919.565385:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663674240 00000100:00100000:0.0:1790778919.565463:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790778919.565480:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663674240:12345-0@lo:503: 00000100:00100000:0.0:1790778919.566504:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663674240:12345-0@lo:503: Request processed in 1024us (2850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778919.566516:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790778919.566566:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663674240:0@lo:503: 00000100:00100000:1.0:1790778919.567092:0:8840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8840:1877767663674368:0@lo:502: 00000100:00100000:1.0:1790778919.567171:0:8840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778919.567212:0:8840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707ea0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.567284:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663674368 00000100:00100000:3.0:1790778919.567291:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663674368 00000100:00100000:3.0:1790778919.567331:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790778919.567341:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:8840:x1877767663674368:12345-0@lo:502: 00000100:00100000:3.0:1790778919.567490:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:8840:x1877767663674368:12345-0@lo:502: Request processed in 151us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.567501:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790778919.567556:0:8840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8840:1877767663674368:0@lo:502: 00000020:01000000:0.0:1790778919.568442:0:8840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790778919.568456:0:8840:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790778919.568470:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778919.568479:0:8840:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790778919.568487:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790778919.568491:0:8840:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:0.0:1790778919.568520:0:8840:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790778919.568523:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790778919.568546:0:8840:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9b7735a6b380) 00000020:00000080:0.0:1790778919.568576:0:8840:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1790778919.568581:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790778919.569206:0:8840:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1790778919.569216:0:8840:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790778919.569226:0:8840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936c980 00010000:00080000:0.0:1790778919.569264:0:8840:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b77182bc000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1790778919.569696:0:8840:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1790778919.592820:0:8840:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790778919.592854:0:8840:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1790778919.593588:0:8840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790778919.594181:0:8840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790778919.594280:0:8840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1790778919.594374:0:8840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790778919.597366:0:8843:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790778919.597375:0:8843:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790778919.598196:0:8840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790778919.598211:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790778919.598260:0:8840:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790778919.598289:0:8840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936c987 00000100:00080000:0.0:1790778919.598303:0:8840:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790778919.598318:0:8840:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b77182bc000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790778919.598369:0:8840:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b77041ad500 x1877767663674496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790778919.598402:0:8840:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790778919.598469:0:8840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778919.598473:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778919.598476:0:8840:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790778919.598479:0:8840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778919.598484:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778919.598485:0:8840:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790778919.598497:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790778919.598499:0:8840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790778919.598534:0:8840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8840:1877767663674624:0@lo:502: 00000100:00100000:0.0:1790778919.598637:0:8840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778919.598761:0:8840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707ea0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778919.598993:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663675008:0@lo:400: 00000100:00100000:0.0:1790778919.599029:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778919.599054:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778919.599061:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663675136:0@lo:400: 00000100:00100000:0.0:1790778919.599088:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778919.599124:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663675136 00000100:00100000:0.0:1790778919.599132:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663675136 00000100:00100000:0.0:1790778919.599181:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790778919.599190:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663675136:12345-0@lo:400: 00000100:00100000:0.0:1790778919.599250:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663675136:12345-0@lo:400: Request processed in 60us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778919.599258:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790778919.599304:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663675136:0@lo:400: 00000100:00100000:0.0:1790778919.599330:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663674624 00000100:00100000:0.0:1790778919.599334:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663674624 00000100:00100000:0.0:1790778919.599357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790778919.599364:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:8840:x1877767663674624:12345-0@lo:502: 00000100:00100000:0.0:1790778919.599495:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:8840:x1877767663674624:12345-0@lo:502: Request processed in 131us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778919.599503:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790778919.599550:0:8840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8840:1877767663674624:0@lo:502: 00000020:01000000:0.0:1790778919.599576:0:8840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778919.599585:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778919.599588:0:8840:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790778919.599593:0:8840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:3.0:1790778919.600368:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663674496:0@lo:8: 00000100:00100000:3.0:1790778919.600438:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.600527:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663674752:0@lo:400: 00000100:00100000:3.0:1790778919.600567:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.600598:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663675264:0@lo:400: 00000100:00100000:3.0:1790778919.600629:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.600662:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790778919.600682:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663674880:0@lo:400: 00000100:00100000:3.0:1790778919.600727:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.600760:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663675392:0@lo:400: 00000100:00100000:3.0:1790778919.600789:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.600833:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663675008 00000100:00100000:3.0:1790778919.600841:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663675008 00000100:00100000:3.0:1790778919.600919:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663674752 00000100:00100000:3.0:1790778919.600922:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663674752 00000100:00100000:3.0:1790778919.600940:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663675264 00000100:00100000:3.0:1790778919.600942:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663675264 00000100:00100000:3.0:1790778919.600967:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663675392 00000100:00100000:3.0:1790778919.600970:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663675392 00000100:00100000:3.0:1790778919.600987:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790778919.600995:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663675008:12345-0@lo:400: 00000100:00100000:3.0:1790778919.601051:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663675008:12345-0@lo:400: Request processed in 56us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.601058:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790778919.601074:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790778919.601080:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663674752:12345-0@lo:400: 00000100:00100000:3.0:1790778919.601113:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663674752:12345-0@lo:400: Request processed in 33us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.601119:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790778919.601132:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790778919.601137:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663675264:12345-0@lo:400: 00000100:00100000:3.0:1790778919.601164:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663675264:12345-0@lo:400: Request processed in 28us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.601170:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790778919.601181:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790778919.601187:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663675392:12345-0@lo:400: 00000100:00100000:3.0:1790778919.601212:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663675392:12345-0@lo:400: Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.601304:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1790778919.601333:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790778919.601337:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778919.601348:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663674880 00000100:00100000:3.0:1790778919.601351:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663674880 00000100:00100000:3.0:1790778919.601377:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790778919.601383:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663674880:12345-0@lo:400: 00000100:00100000:3.0:1790778919.601430:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663674880:12345-0@lo:400: Request processed in 47us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.601436:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1790778919.601477:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b77041afb80 x1877767663675008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.601493:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663675008:0@lo:400: 00000100:00100000:3.0:1790778919.601521:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663674880:0@lo:400: 00010000:00080000:3.0:1790778919.601529:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7f4700 x1877767663675392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.601537:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663675392:0@lo:400: 00010000:00080000:3.0:1790778919.601545:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b77041ace00 x1877767663674752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.601551:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663674752:0@lo:400: 00010000:00080000:3.0:1790778919.601560:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7f7100 x1877767663675264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.601565:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663675264:0@lo:400: 00000020:01000000:3.0:1790778919.601592:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1790778919.601635:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1790778919.601646:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.601657:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778919.601669:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790778919.601672:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b77208a9000 from 30 10000000:01000000:3.0:1790778919.601675:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790778919.601707:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.601715:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.601727:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778919.601744:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663675520:0@lo:101: 00000100:00100000:3.0:1790778919.601777:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.601806:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663675520 00000100:00100000:3.0:1790778919.601809:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663675520 00000100:00100000:3.0:1790778919.601837:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790778919.601843:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663675520:12345-0@lo:101: 00010000:00010000:3.0:1790778919.601852:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778919.601867:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c98e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.601925:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c98e expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.601946:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c98e expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.601956:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663e00, rc 0) 00000100:00100000:3.0:1790778919.601983:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663675520:12345-0@lo:101: Request processed in 140us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.601988:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790778919.602036:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.602048:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663675520:0@lo:101: 00010000:00010000:3.0:1790778919.602062:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.602072:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778919.602130:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663675648:0@lo:501: 00000100:00100000:3.0:1790778919.602159:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.602174:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.602187:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663675648 00000100:00100000:3.0:1790778919.602190:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663675648 00000100:00100000:3.0:1790778919.602211:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790778919.602219:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663675648:12345-0@lo:501: 00000100:00100000:3.0:1790778919.602364:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663675648:12345-0@lo:501: Request processed in 145us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.602372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790778919.602418:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663675648:0@lo:501: 00000100:00100000:3.0:1790778919.602465:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663675776:0@lo:503: 00000100:00100000:3.0:1790778919.602517:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.602540:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.602560:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663675776 00000100:00100000:3.0:1790778919.602565:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663675776 00000100:00100000:3.0:1790778919.602597:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790778919.602608:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663675776:12345-0@lo:503: 00000100:00100000:3.0:1790778919.602711:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663675776:12345-0@lo:503: Request processed in 105us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.602720:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790778919.602784:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663675776:0@lo:503: 00000100:00100000:2.0:1790778919.603319:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663674496 00000100:00100000:2.0:1790778919.603327:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663674496 00000100:00100000:2.0:1790778919.603364:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778919.603371:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1877767663674496:12345-0@lo:8: 00010000:00080000:2.0:1790778919.603412:0:8438:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1790778919.603446:0:8438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936c99c 00002000:00100000:2.0:1790778919.603506:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9b7601dc9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790778919.603511:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1790778919.603516:0:8438:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790778919.603602:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790778919.603938:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1790778919.603970:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9b7601dcf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790778919.604051:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1877767663674496:12345-0@lo:8: Request processed in 679us (3612us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778919.604058:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790778919.606336:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b77041ad500 x1877767663674496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790778929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.606355:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790778919.606368:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1790778919.606379:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790778919.606387:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790778919.606391:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77182bc000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790778919.610910:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790778919.610928:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663674496:0@lo:8: 00000004:00080000:3.0:1790778919.610997:0:8843:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790778919.611117:0:8843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 237618236496ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790778919.611127:0:8843:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1790778919.611633:0:8844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8844:1877767663675904:0@lo:700: 00000100:00100000:2.0:1790778919.611766:0:8844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778919.611812:0:8844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720163f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.611967:0:8446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663675904 00000100:00100000:3.0:1790778919.611976:0:8446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663675904 00000100:00100000:3.0:1790778919.612708:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790778919.612733:0:8446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8844:x1877767663675904:12345-0@lo:700: 00000100:00100000:3.0:1790778919.612793:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8446:1877767663676032:0@lo:700: 00000100:00100000:3.0:1790778919.612845:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.612875:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc2c00 going to sleep for 11 seconds 00000100:00080000:2.0:1790778919.615501:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778919.615551:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663676032 00000100:00100000:2.0:1790778919.615564:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663676032 00000100:00100000:2.0:1790778919.615638:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790778919.615650:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8446:x1877767663676032:12345-0@lo:700: 00000100:00100000:3.0:1790778919.616794:0:8845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8845:1877767663676160:0@lo:502: 00000100:00100000:3.0:1790778919.616939:0:8845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.616986:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663676160 00000100:00100000:3.0:1790778919.616991:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663676160 00000100:00100000:3.0:1790778919.617033:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790778919.617043:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:8845:x1877767663676160:12345-0@lo:502: 00000100:00100000:3.0:1790778919.617175:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:8845:x1877767663676160:12345-0@lo:502: Request processed in 133us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.617183:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790778919.617250:0:8845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc2480 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.617278:0:8845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8845:1877767663676160:0@lo:502: 00000100:00100000:3.0:1790778919.617333:0:8845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8845:1877767663676288:0@lo:502: 00000100:00100000:3.0:1790778919.617369:0:8845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.618938:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663676288 00000100:00100000:3.0:1790778919.618953:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663676288 00000100:00100000:3.0:1790778919.619007:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790778919.619017:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:8845:x1877767663676288:12345-0@lo:502: 00000100:00100000:3.0:1790778919.619157:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:8845:x1877767663676288:12345-0@lo:502: Request processed in 141us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.619165:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790778919.619220:0:8845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720167240 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.619244:0:8845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8845:1877767663676288:0@lo:502: 00000040:00080000:3.0:1790778919.619284:0:8845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790778919.619862:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1790778919.619939:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790778919.619953:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778919.619966:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778919.619991:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790778919.619994:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b77208a9000 from 5 10000000:01000000:0.0:1790778919.619997:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790778919.620038:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778919.620047:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778919.620057:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778919.620081:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663676416:0@lo:101: 00000100:00100000:0.0:1790778919.620136:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778919.620171:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.621355:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663676416 00000004:00080000:0.0:1790778919.621404:0:7455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1790778919.621496:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663676416 00000100:00100000:3.0:1790778919.621563:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790778919.621576:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663676416:12345-0@lo:101: 00010000:00010000:3.0:1790778919.621597:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778919.621625:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c9aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c9a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.621663:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c9a3 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.621677:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c9a3 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.621687:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662800, rc 0) 00000100:00100000:3.0:1790778919.621776:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663676416:12345-0@lo:101: Request processed in 203us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.621784:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790778919.622053:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663676416:0@lo:101: 00010000:00010000:0.0:1790778919.622078:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778919.622107:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778919.622178:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663676544:0@lo:256: 00000100:00100000:0.0:1790778919.622222:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778919.622254:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663676544 00000100:00100000:0.0:1790778919.622259:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663676544 00000100:00100000:0.0:1790778919.622290:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790778919.622297:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663676544:12345-0@lo:256: 20000000:01000000:0.0:1790778919.622317:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790778919.622343:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790778919.622347:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1790778919.622441:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663676544:12345-0@lo:256: Request processed in 144us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778919.622449:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790778919.622486:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778919.622497:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663676544:0@lo:256: 10000000:01000000:0.0:1790778919.622539:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790778919.622545:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778919.622551:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778919.622558:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790778919.622560:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1790778919.622562:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790778919.622581:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778919.622588:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778919.622597:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778919.622610:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663676672:0@lo:101: 00000100:00100000:0.0:1790778919.622636:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778919.622674:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.622730:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663676672 00000100:00100000:3.0:1790778919.622735:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663676672 00000100:00100000:3.0:1790778919.622830:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790778919.622837:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663676672:12345-0@lo:101: 00010000:00010000:3.0:1790778919.622845:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778919.622856:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c9b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c9b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.622873:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c9b1 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.622920:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c9b1 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778919.622929:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663800, rc 0) 00000100:00100000:3.0:1790778919.622970:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663676672:12345-0@lo:101: Request processed in 134us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.622977:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790778919.623119:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663676672:0@lo:101: 00010000:00010000:0.0:1790778919.623137:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778919.623146:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778919.623222:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663676800:0@lo:501: 00000100:00100000:0.0:1790778919.623242:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778919.623268:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.623300:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663676800 00000100:00100000:3.0:1790778919.623304:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663676800 00000100:00100000:3.0:1790778919.623348:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790778919.623354:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663676800:12345-0@lo:501: 00000100:00100000:3.0:1790778919.624181:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663676800:12345-0@lo:501: Request processed in 821us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.624193:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 40000000:02000000:3.0:1790778919.626056:0:6530:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1790778919.630642:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663676800:0@lo:501: 00000100:00100000:2.0:1790778919.630787:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663676928:0@lo:503: 00000100:00100000:2.0:1790778919.630914:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778919.630980:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77201630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778919.631014:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663676928 00000100:00100000:2.0:1790778919.631024:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663676928 00000100:00100000:2.0:1790778919.631955:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790778919.631974:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663676928:12345-0@lo:503: 00000100:00100000:2.0:1790778919.632167:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663676928:12345-0@lo:503: Request processed in 199us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778919.632177:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790778919.636026:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663676928:0@lo:503: 00000100:00100000:0.0:1790778919.638116:0:8848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8848:1877767663677056:0@lo:502: 00000100:00100000:0.0:1790778919.638205:0:8848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778919.638253:0:8848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790778919.638676:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663677056 00000100:00100000:1.0:1790778919.638685:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663677056 00000100:00100000:1.0:1790778919.638735:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790778919.638746:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:8848:x1877767663677056:12345-0@lo:502: 00000100:00100000:3.0:1790778919.638835:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8446:x1877767663676032:12345-0@lo:700: Request processed in 23174us (25976us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.638851:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790778919.638952:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b760300bb80 x1877767663676032/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790778935 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.638971:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8446:1877767663676032:0@lo:700: 40000000:02000000:3.0:1790778919.638986:0:8446:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:1.0:1790778919.640842:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:8848:x1877767663677056:12345-0@lo:502: Request processed in 2079us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778919.640938:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790778919.641285:0:8848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8848:1877767663677056:0@lo:502: 00000020:01000000:0.0:1790778919.641321:0:8848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790778919.641329:0:8848:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1790778919.641345:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778919.641347:0:8848:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790778919.641431:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790778919.641437:0:8848:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:0.0:1790778919.641463:0:8848:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790778919.641466:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790778919.641482:0:8848:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b7735a6cd40) 00000020:00000080:0.0:1790778919.641504:0:8848:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1790778919.641510:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790778919.641614:0:8848:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790778919.641620:0:8848:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:0.0:1790778919.641626:0:8848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936c9c6 00010000:00080000:0.0:1790778919.641664:0:8848:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7704184800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1790778919.642178:0:8848:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:1.0:1790778919.664800:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1790778919.665075:0:8446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8844:x1877767663675904:12345-0@lo:700: Request processed in 52343us (53304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778919.665092:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790778919.665210:0:8844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b77041a6680 x1877767663675904/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790778935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.665225:0:8844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8844:1877767663675904:0@lo:700: 00000040:01000000:3.0:1790778919.680309:0:8848:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1790778919.680335:0:8848:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790778919.681060:0:8848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778919.681267:0:8848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778919.683251:0:8848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1790778919.684533:0:8848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000004:00080000:3.0:1790778919.694560:0:8844:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790778919.694590:0:8844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8844:1877767663677312:0@lo:7: 00000100:00100000:3.0:1790778919.696550:0:8844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.696628:0:8844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720167cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.696654:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663677184:0@lo:13: 00000100:00100000:3.0:1790778919.696686:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778919.696707:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663677312 00000100:00100000:1.0:1790778919.696726:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663677312 00000100:00100000:1.0:1790778919.696813:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790778919.696826:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8844:x1877767663677312:12345-0@lo:7: 00000100:00100000:2.0:1790778919.696872:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663677184 00000100:00100000:2.0:1790778919.696908:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663677184 00000100:00100000:2.0:1790778919.696974:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778919.696985:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1877767663677184:12345-0@lo:13: 00002000:00000024:2.0:1790778919.697023:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1790778919.697076:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1877767663677184:12345-0@lo:13: Request processed in 93us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778919.697083:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790778919.697135:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b760300bb80 x1877767663677184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778919.697158:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663677184:0@lo:13: 00000040:00080000:0.0:1790778919.698757:0:8852:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790778919.698764:0:8852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790778919.699828:0:8848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790778919.699839:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790778919.699874:0:8848:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790778919.699922:0:8848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936c9cd 00000100:00080000:3.0:1790778919.699932:0:8848:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790778919.699953:0:8848:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b7704184800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790778919.699988:0:8848:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b760300aa00 x1877767663677440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790778919.700011:0:8848:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790778919.700058:0:8848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790778919.700062:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778919.700064:0:8848:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790778919.700067:0:8848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790778919.700071:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778919.700072:0:8848:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790778919.700074:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790778919.700076:0:8848:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790778919.700105:0:8848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8848:1877767663677568:0@lo:502: 00000100:00100000:3.0:1790778919.700171:0:8848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.700205:0:8848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77201670c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.700225:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663677568 00000100:00100000:3.0:1790778919.700230:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663677568 00000100:00100000:3.0:1790778919.700273:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790778919.700281:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+20:8848:x1877767663677568:12345-0@lo:502: 00000100:00100000:3.0:1790778919.702108:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+20:8848:x1877767663677568:12345-0@lo:502: Request processed in 1820us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.702120:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790778919.702323:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663677440:0@lo:8: 00000100:00100000:0.0:1790778919.702375:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778919.705927:0:8848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:8848:1877767663677568:0@lo:502: 00000020:01000000:2.0:1790778919.705983:0:8848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778919.705992:0:8848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778919.705994:0:8848:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790778919.705999:0:8848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1790778919.706445:0:8438:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790778919.706455:0:8438:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1790778919.706741:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663677440 00000100:00100000:2.0:1790778919.706749:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663677440 00000020:01000000:2.0:1790778919.708410:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1790778919.708449:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790778919.708461:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778919.708474:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778919.708487:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790778919.708490:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b773059cd40 from 1 10000000:01000000:2.0:1790778919.708493:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790778919.708529:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778919.708536:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778919.708546:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778919.708587:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663677696:0@lo:101: 00000100:00100000:2.0:1790778919.708666:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778919.708713:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720163000 going to sleep for 11 seconds 00000100:00100000:3.0:1790778919.708941:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790778919.708954:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1877767663677440:12345-0@lo:8: 00010000:00080000:3.0:1790778919.708982:0:8855:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:3.0:1790778919.709008:0:8855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936c9db 00002000:00100000:3.0:1790778919.709023:0:8855:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b7601e12000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790778919.709027:0:8855:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1790778919.709029:0:8855:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790778919.709107:0:8855:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790778919.709132:0:8855:0:(import.c:65:import_set_state_nolock()) ffff9b7601e14000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778919.709192:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1877767663677440:12345-0@lo:8: Request processed in 236us (6816us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.709199:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790778919.710167:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663677696 00000100:00100000:1.0:1790778919.710185:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663677696 00000100:00100000:1.0:1790778919.710252:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790778919.710275:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663677696:12345-0@lo:101: 00010000:00010000:1.0:1790778919.710293:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778919.710314:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936c9e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c9d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.710348:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936c9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c9d4 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.711487:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936c9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c9d4 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778919.711504:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894ac00, rc 0) 00000100:00100000:1.0:1790778919.711705:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663677696:12345-0@lo:101: Request processed in 1431us (3037us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778919.711735:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:0.0:1790778919.714043:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b760300aa00 x1877767663677440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790778929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778919.714060:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790778919.714071:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790778919.714083:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790778919.714090:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790778919.714094:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704184800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790778919.714127:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790778919.714136:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663677440:0@lo:8: 00000004:00080000:0.0:1790778919.714176:0:8852:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790778919.714275:0:8852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 237721395264ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790778919.714285:0:8852:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1790778919.723083:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663677696:0@lo:101: 00010000:00010000:2.0:1790778919.723129:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778919.723145:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790778919.723587:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1790778919.723785:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663677824:0@lo:501: 00000100:00100000:3.0:1790778919.723853:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.723921:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77201673c0 going to sleep for 11 seconds 00002000:00080000:1.0:1790778919.724230:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1790778919.724240:0:8440:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790778919.724361:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8844:x1877767663677312:12345-0@lo:7: Request processed in 27533us (27812us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778919.724374:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790778919.724428:0:8844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603009880 x1877767663677312/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790778935 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.724445:0:8844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8844:1877767663677312:0@lo:7: 00000004:00080000:3.0:1790778919.724456:0:8844:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790778919.724480:0:8844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8844:1877767663677952:0@lo:5: 00000100:00100000:3.0:1790778919.724516:0:8844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.724540:0:8844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720167cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778919.725520:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663677824 00000100:00100000:2.0:1790778919.725532:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663677824 00000100:00100000:2.0:1790778919.725595:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790778919.725607:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663677824:12345-0@lo:501: 00000100:00100000:2.0:1790778919.725761:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663677824:12345-0@lo:501: Request processed in 157us (1909us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790778919.725769:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790778919.725811:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663677952 00000100:00100000:2.0:1790778919.725816:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663677952 00000100:00100000:2.0:1790778919.725845:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790778919.725852:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8844:x1877767663677952:12345-0@lo:5: 00002000:00080000:2.0:1790778919.725877:0:8438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1790778919.725930:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8844:x1877767663677952:12345-0@lo:5: Request processed in 79us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778919.725937:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790778919.727154:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663677824:0@lo:501: 10000000:01000000:0.0:1790778919.727204:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790778919.727215:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778919.727232:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1790778919.727529:0:8844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603009880 x1877767663677952/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778935 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.727543:0:8844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8844:1877767663677952:0@lo:5: 00000004:00080000:3.0:1790778919.727558:0:8844:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790778919.727605:0:8844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8844:1877767663678080:0@lo:5: 00000100:00100000:3.0:1790778919.727657:0:8844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.727693:0:8844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720167cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778919.727782:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663678080 00000100:00100000:0.0:1790778919.727789:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663678080 00000100:00100000:0.0:1790778919.727850:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778919.727862:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8844:x1877767663678080:12345-0@lo:5: 00002000:00080000:0.0:1790778919.727939:0:8855:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1790778919.731122:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8844:x1877767663678080:12345-0@lo:5: Request processed in 3256us (3455us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790778919.731134:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790778919.731198:0:8844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603009880 x1877767663678080/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778919.731234:0:8844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8844:1877767663678080:0@lo:5: 00000004:00080000:2.0:1790778919.731255:0:8844:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1790778919.731501:0:8844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8844:1877767663678208:0@lo:900: 00000100:00100000:2.0:1790778919.731563:0:8844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778919.731602:0:8844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720163f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790778919.731845:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790778919.731863:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663678336:0@lo:13: 00000100:00100000:2.0:1790778919.731926:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778919.731959:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663678336 00000100:00100000:2.0:1790778919.731967:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663678336 00000100:00100000:2.0:1790778919.732036:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790778919.732048:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663678336:12345-0@lo:13: 00002000:00000024:2.0:1790778919.732074:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1790778919.732120:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663678208 00000100:00100000:2.0:1790778919.732127:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663678336:12345-0@lo:13: Request processed in 80us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.732133:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663678208 00000100:00100000:2.0:1790778919.732139:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790778919.732175:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790778919.732203:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7704142d80 x1877767663678336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778919.732222:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663678336:0@lo:13: 00000100:00100000:3.0:1790778919.732232:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790778919.732244:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8844:x1877767663678208:12345-0@lo:900: 00000004:00080000:2.0:1790778919.732253:0:8853:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790778919.732320:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8844:x1877767663678208:12345-0@lo:900: Request processed in 78us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778919.732328:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790778919.735867:0:8853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704142d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8853:1877767663678464:0@lo:7: 00000100:00100000:2.0:1790778919.735990:0:8853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778919.736061:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663678464 00000100:00100000:2.0:1790778919.736071:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663678464 00000100:00100000:2.0:1790778919.736141:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790778919.736152:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8853:x1877767663678464:12345-0@lo:7: 00010000:00080000:3.0:1790778919.740770:0:8844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7704143100 x1877767663678208/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790778935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.740801:0:8844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8844:1877767663678208:0@lo:900: 00000100:00100000:3.0:1790778919.742001:0:8853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77201630c0 going to sleep for 11 seconds 00002000:00080000:2.0:1790778919.742578:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1790778919.742586:0:8438:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790778919.742683:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8853:x1877767663678464:12345-0@lo:7: Request processed in 6529us (6690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778919.742694:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790778919.742732:0:8853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7704142d80 x1877767663678464/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790778935 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.742747:0:8853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704142d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8853:1877767663678464:0@lo:7: 00000004:00080000:3.0:1790778919.742761:0:8853:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790778919.742800:0:8853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8853:1877767663678592:0@lo:5: 00000100:00100000:3.0:1790778919.742846:0:8853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778919.742907:0:8853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720167540 going to sleep for 11 seconds 00000100:00100000:2.0:1790778919.745323:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663678592 00000100:00100000:2.0:1790778919.745338:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663678592 00000100:00100000:2.0:1790778919.745414:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790778919.745425:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8853:x1877767663678592:12345-0@lo:5: 00002000:00080000:2.0:1790778919.745461:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790778919.745465:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1790778919.750860:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1790778919.750908:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1790778919.750919:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790778919.751426:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8853:x1877767663678592:12345-0@lo:5: Request processed in 5995us (8571us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790778919.751439:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790778919.754596:0:8853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b760300aa00 x1877767663678592/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778935 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778919.754618:0:8853:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790778919.754627:0:8853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8853:1877767663678592:0@lo:5: 00000004:00080000:1.0:1790778919.754649:0:8853:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790778919.754728:0:8853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8853:1877767663678720:0@lo:700: 00000100:00100000:1.0:1790778919.754822:0:8853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778919.754922:0:8853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78540 going to sleep for 11 seconds 00000100:00100000:2.0:1790778919.754926:0:8447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663678720 00000100:00100000:2.0:1790778919.754944:0:8447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663678720 00000100:00100000:2.0:1790778919.755017:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790778919.755030:0:8447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8853:x1877767663678720:12345-0@lo:700: 00000100:00100000:2.0:1790778919.766656:0:8447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8853:x1877767663678720:12345-0@lo:700: Request processed in 11620us (11825us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778919.766672:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790778919.766741:0:8853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b772fe25f80 x1877767663678720/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790778935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778919.766762:0:8853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8853:1877767663678720:0@lo:700: 00000004:02000040:1.0:1790778919.771141:0:8853:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1790778919.785148:0:8853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8853:1877767663678848:0@lo:5: 00000100:00100000:1.0:1790778919.785216:0:8853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778919.785262:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663678848 00000100:00100000:1.0:1790778919.785275:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663678848 00000100:00100000:1.0:1790778919.786753:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790778919.786769:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8853:x1877767663678848:12345-0@lo:5: 00000100:00100000:2.0:1790778919.790146:0:8853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78540 going to sleep for 11 seconds 00002000:00080000:1.0:1790778919.792387:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1790778919.792419:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1790778919.796845:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8853:x1877767663678848:12345-0@lo:5: Request processed in 10072us (11619us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790778919.796859:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1790778919.797152:0:8853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b772fe25f80 x1877767663678848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778919.797171:0:8853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8853:1877767663678848:0@lo:5: 00000004:00080000:3.0:1790778919.797187:0:8853:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:1.0:1790778919.815082:0:8866:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790778919.816225:0:8866:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790778919.848133:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790778920.699998:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1790778920.872170:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778921.576600:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663678976:0@lo:41: 00000100:00100000:0.0:1790778921.576684:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778921.576868:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663678976 00000100:00100000:3.0:1790778921.576876:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663678976 00000100:00100000:3.0:1790778921.576940:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790778921.576949:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663678976:12345-0@lo:41: 00000004:00000024:3.0:1790778921.576984:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1790778921.577069:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663678976:12345-0@lo:41: Request processed in 121us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778921.577076:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790778921.577323:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663678976:0@lo:41: 00010000:00010000:0.0:1790778921.896070:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790778922.594226:0:8967:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790778922.594513:0:8967:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790778922.920247:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790778923.427792:0:9015:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778923.427802:0:9015:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1790778923.624212:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778923.624239:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663679104:0@lo:41: 00000100:00100000:2.0:1790778923.624310:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778923.625032:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663679104 00000100:00100000:0.0:1790778923.625044:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663679104 00000100:00100000:0.0:1790778923.625099:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790778923.625108:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663679104:12345-0@lo:41: 00000004:00000024:0.0:1790778923.625142:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1790778923.625203:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663679104:12345-0@lo:41: Request processed in 96us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778923.625210:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790778923.625258:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663679104:0@lo:41: 00010000:00010000:0.0:1790778923.944090:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778924.973402:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778925.160069:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663679232:0@lo:13: 00000100:00100000:0.0:1790778925.160167:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778925.160226:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778925.160232:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663679360:0@lo:13: 00000100:00100000:0.0:1790778925.160252:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778925.160284:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663679232 00000100:00100000:0.0:1790778925.160292:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663679232 00000100:00100000:0.0:1790778925.160329:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663679360 00000100:00100000:0.0:1790778925.160331:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663679360 00000100:00100000:0.0:1790778925.160346:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790778925.160367:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663679232:12345-0@lo:13: 00002000:00000024:0.0:1790778925.160394:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778925.160437:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663679232:12345-0@lo:13: Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778925.160444:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790778925.160465:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790778925.160476:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663679360:12345-0@lo:13: 00002000:00000024:3.0:1790778925.160489:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790778925.160529:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663679360:12345-0@lo:13: Request processed in 54us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778925.160569:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663679616:0@lo:400: 00000100:00100000:2.0:1790778925.160596:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778925.160612:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663680128:0@lo:400: 00000100:00100000:2.0:1790778925.160628:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778925.160642:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790778925.160647:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663679488:0@lo:400: 00000100:00100000:2.0:1790778925.160668:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778925.160687:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663680000:0@lo:400: 00000100:00100000:2.0:1790778925.160704:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778925.160725:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663679488 00000100:00100000:2.0:1790778925.160728:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663679488 00000100:00100000:2.0:1790778925.160751:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790778925.160757:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:3650:x1877767663679488:12345-0@lo:400: 00000100:00100000:2.0:1790778925.160858:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:3650:x1877767663679488:12345-0@lo:400: Request processed in 101us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778925.160865:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790778925.160918:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663679488:0@lo:400: 00000100:00100000:2.0:1790778925.160943:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663679616 00000100:00100000:2.0:1790778925.160946:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663679616 00000100:00100000:2.0:1790778925.160967:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663680128 00000100:00100000:2.0:1790778925.160969:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663680128 00000100:00100000:2.0:1790778925.160981:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790778925.160987:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663679616:12345-0@lo:400: 00000100:00100000:2.0:1790778925.161018:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663679616:12345-0@lo:400: Request processed in 31us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778925.161024:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790778925.161045:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790778925.161050:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663680128:12345-0@lo:400: 00000100:00100000:2.0:1790778925.161074:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663680128:12345-0@lo:400: Request processed in 24us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778925.161079:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1790778925.161101:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b768000 x1877767663679616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778925.161112:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663679616:0@lo:400: 00010000:00080000:2.0:1790778925.161121:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b769c00 x1877767663680128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778925.161129:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663680128:0@lo:400: 00000100:00080000:0.0:1790778925.162641:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790778925.162650:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778925.162668:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663680000 00000100:00100000:0.0:1790778925.162676:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663680000 00000100:00100000:0.0:1790778925.162722:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790778925.162731:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663680000:12345-0@lo:400: 00000100:00100000:0.0:1790778925.162802:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663680000:12345-0@lo:400: Request processed in 73us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778925.162810:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790778925.162930:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663679872:0@lo:400: 00000100:00100000:0.0:1790778925.162964:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778925.163003:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790778925.163009:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663679744:0@lo:400: 00000100:00100000:0.0:1790778925.163034:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778925.163050:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663680256:0@lo:400: 00000100:00100000:0.0:1790778925.163074:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778925.163097:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663679744 00000100:00100000:0.0:1790778925.163101:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663679744 00000100:00100000:0.0:1790778925.163122:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790778925.163128:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663679744:12345-0@lo:400: 00000100:00100000:0.0:1790778925.163160:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663679744:12345-0@lo:400: Request processed in 32us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778925.163166:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790778925.163191:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663679872 00000100:00100000:0.0:1790778925.163195:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663679872 00000100:00100000:0.0:1790778925.163213:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663680256 00000100:00100000:0.0:1790778925.163215:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663680256 00000100:00100000:0.0:1790778925.163239:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790778925.163245:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663679872:12345-0@lo:400: 00000100:00100000:0.0:1790778925.163276:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663679872:12345-0@lo:400: Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778925.163282:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790778925.163293:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790778925.163299:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663680256:12345-0@lo:400: 00000100:00100000:0.0:1790778925.163341:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663680256:12345-0@lo:400: Request processed in 42us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778925.163347:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1790778925.163377:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790778925.163406:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663679744:0@lo:400: 00010000:00080000:0.0:1790778925.163427:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b76b100 x1877767663680256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778925.163437:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663680256:0@lo:400: 00010000:00080000:0.0:1790778925.163446:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b76a300 x1877767663679872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778925.163454:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663679872:0@lo:400: 00010000:00080000:0.0:1790778925.163487:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7704143100 x1877767663679360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778925.163495:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1790778925.163508:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663679360:0@lo:13: 00010000:00080000:0.0:1790778925.163521:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b769500 x1877767663679232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778925.163527:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790778925.163537:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663679232:0@lo:13: 00000100:00100000:0.0:1790778925.163567:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663680000:0@lo:400: 00000100:00100000:3.0:1790778925.169439:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790778925.994936:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778926.696114:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790778926.696140:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663680384:0@lo:41: 00000100:00100000:1.0:1790778926.696208:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778926.696323:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663680384 00000100:00100000:3.0:1790778926.696331:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663680384 00000100:00100000:3.0:1790778926.696393:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790778926.696402:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663680384:12345-0@lo:41: 00000004:00000024:3.0:1790778926.696435:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1790778926.696486:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663680384:12345-0@lo:41: Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778926.696493:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790778926.696536:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663680384:0@lo:41: 00010000:00010000:2.0:1790778927.017064:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778928.039991:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778928.747286:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663680512:0@lo:41: 00000100:00100000:0.0:1790778928.747482:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778928.748194:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663680512 00000100:00100000:3.0:1790778928.748203:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663680512 00000100:00100000:3.0:1790778928.748245:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790778928.748253:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663680512:12345-0@lo:41: 00000004:00000024:3.0:1790778928.748286:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1790778928.748414:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663680512:12345-0@lo:41: Request processed in 161us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778928.748422:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790778928.748475:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663680512:0@lo:41: 00010000:00010000:2.0:1790778929.064857:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778930.095824:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778930.280346:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663680640:0@lo:13: 00000100:00100000:0.0:1790778930.280410:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778930.280476:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663680640 00000100:00100000:0.0:1790778930.280489:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663680640 00000100:00100000:0.0:1790778930.280531:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778930.280539:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663680640:12345-0@lo:13: 00002000:00000024:0.0:1790778930.280565:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778930.280601:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663680640:12345-0@lo:13: Request processed in 63us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778930.280607:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790778930.280624:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790778930.280646:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7f7480 x1877767663680640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778930.280663:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663680640:0@lo:13: 00000100:00100000:2.0:1790778930.280797:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778930.280808:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663680768:0@lo:13: 00000100:00100000:2.0:1790778930.280836:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778930.280862:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663680768 00000100:00100000:2.0:1790778930.280866:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663680768 00000100:00100000:2.0:1790778930.280920:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790778930.280927:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663680768:12345-0@lo:13: 00002000:00000024:2.0:1790778930.280936:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778930.280959:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663680768:12345-0@lo:13: Request processed in 33us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778930.280965:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790778930.281027:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663681024:0@lo:400: 00000100:00100000:2.0:1790778930.281050:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778930.281072:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663681536:0@lo:400: 00000100:00100000:2.0:1790778930.281089:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778930.281117:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790778930.281122:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663681152:0@lo:400: 00000100:00100000:2.0:1790778930.281141:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778930.281154:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663681664:0@lo:400: 00000100:00100000:2.0:1790778930.281172:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778930.281191:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663681024 00000100:00100000:2.0:1790778930.281194:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663681024 00000100:00100000:2.0:1790778930.281213:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663681536 00000100:00100000:2.0:1790778930.281216:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663681536 00000100:00100000:2.0:1790778930.281227:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663681664 00000100:00100000:2.0:1790778930.281229:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663681664 00000100:00100000:2.0:1790778930.281242:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790778930.281248:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663681024:12345-0@lo:400: 00000100:00100000:2.0:1790778930.281282:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663681024:12345-0@lo:400: Request processed in 34us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778930.281288:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790778930.281320:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790778930.281328:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663681536:12345-0@lo:400: 00000100:00100000:2.0:1790778930.281351:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663681536:12345-0@lo:400: Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778930.281357:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790778930.281366:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790778930.281371:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663681664:12345-0@lo:400: 00000100:00100000:2.0:1790778930.281393:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663681664:12345-0@lo:400: Request processed in 23us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778930.281407:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790778930.281427:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663681152 00000100:00100000:2.0:1790778930.281431:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663681152 00000100:00100000:2.0:1790778930.281452:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790778930.281457:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663681152:12345-0@lo:400: 00000100:00100000:2.0:1790778930.281484:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663681152:12345-0@lo:400: Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778930.281490:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1790778930.281508:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790778930.281510:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790778930.281513:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778930.281521:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663680896:0@lo:400: 00000100:00100000:2.0:1790778930.281543:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778930.281568:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663681408:0@lo:400: 00000100:00100000:2.0:1790778930.281597:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790778930.281618:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b769c00 x1877767663680768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778930.281632:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663680768:0@lo:13: 00000100:00100000:2.0:1790778930.281643:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778930.281648:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663681280:0@lo:400: 00000100:00100000:2.0:1790778930.281666:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778930.281682:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663681408 00000100:00100000:2.0:1790778930.281685:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663681408 00000100:00100000:2.0:1790778930.281702:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790778930.281707:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663681408:12345-0@lo:400: 00000100:00100000:2.0:1790778930.281732:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663681408:12345-0@lo:400: Request processed in 25us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778930.281743:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790778930.281768:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663681152:0@lo:400: 00010000:00080000:2.0:1790778930.281784:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b768380 x1877767663681664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778930.281793:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663681664:0@lo:400: 00010000:00080000:2.0:1790778930.281803:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b76a680 x1877767663681024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778930.281810:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663681024:0@lo:400: 00010000:00080000:2.0:1790778930.281819:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b76ad80 x1877767663681536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778930.281827:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663681536:0@lo:400: 00000100:00100000:2.0:1790778930.281854:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663681408:0@lo:400: 00000100:00100000:2.0:1790778930.281869:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663681280 00000100:00100000:2.0:1790778930.281872:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663681280 00000100:00100000:2.0:1790778930.281911:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790778930.281917:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663681280:12345-0@lo:400: 00000100:00100000:2.0:1790778930.281951:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663681280:12345-0@lo:400: Request processed in 34us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778930.281957:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1790778930.281977:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b769180 x1877767663681280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778930.281986:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663681280:0@lo:400: 00000100:00100000:2.0:1790778930.282010:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663680896 00000100:00100000:2.0:1790778930.282018:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663680896 00000100:00100000:2.0:1790778930.282039:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790778930.282044:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:3652:x1877767663680896:12345-0@lo:400: 00000100:00100000:2.0:1790778930.282072:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:3652:x1877767663680896:12345-0@lo:400: Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778930.282077:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790778930.282103:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663680896:0@lo:400: 00010000:00010000:2.0:1790778931.118332:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778931.816148:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790778931.816173:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663681792:0@lo:41: 00000100:00100000:3.0:1790778931.816247:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778931.816342:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663681792 00000100:00100000:3.0:1790778931.816350:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663681792 00000100:00100000:3.0:1790778931.816395:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790778931.816404:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663681792:12345-0@lo:41: 00000004:00000024:3.0:1790778931.816452:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1790778931.816500:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663681792:12345-0@lo:41: Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778931.816507:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790778931.816552:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663681792:0@lo:41: 00010000:00010000:0.0:1790778932.135998:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790778932.158593:0:9515:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790778932.158597:0:9515:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790778932.158598:0:9515:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790778932.158737:0:9515:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b760310d000 00000020:01000004:2.0:1790778932.158754:0:9515:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790778932.158769:0:9515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790778932.158782:0:9515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b77340999c0) 00000020:00000080:2.0:1790778932.158797:0:9515:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790778932.229799:0:9515:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790778932.229854:0:9515:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1790778932.261641:0:9515:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790778932.261852:0:9515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790778932.261867:0:9515:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790778932.263458:0:9515:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb1aa4014e936c9f0 00000020:01000004:3.0:1790778932.263473:0:9515:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1790778932.263505:0:9515:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790778932.263510:0:9515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790778932.263518:0:9515:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790778932.265078:0:9515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1790778932.265088:0:9515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790778932.297142:0:9515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790778932.297177:0:9515:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1790778932.297182:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790778932.297183:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790778932.297184:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778932.297186:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790778932.297187:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778932.297188:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778932.297190:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790778932.297191:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790778932.297192:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790778932.297194:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778932.297195:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790778932.297199:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1790778932.297201:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790778932.297202:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790778932.297203:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778932.297211:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790778932.297212:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778932.297213:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778932.297214:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790778932.297215:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790778932.297216:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790778932.297217:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778932.297218:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790778932.297243:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790778932.297260:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603022a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663681920:0@lo:253: 00000100:00100000:2.0:1790778932.299630:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.300520:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7602785cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778932.301650:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663681920 00000100:00100000:3.0:1790778932.301661:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663681920 00000100:00100000:3.0:1790778932.301746:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790778932.301757:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:9515:x1877767663681920:12345-0@lo:253: 20000000:01000000:3.0:1790778932.301790:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790778932.301794:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1790778932.301799:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1790778932.301803:0:6518:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1790778932.302107:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778932.302261:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1790778932.302291:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1790778932.302319:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1790778932.302325:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1790778932.302338:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1790778932.302352:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1790778932.302435:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1790778932.302451:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:3.0:1790778932.302453:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:3.0:1790778932.302467:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1790778932.302473:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790778932.302486:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1790778932.302492:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:3.0:1790778932.302505:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1790778932.302512:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1790778932.302524:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1790778932.302540:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1790778932.302608:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1790778932.302619:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:3.0:1790778932.302621:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:3.0:1790778932.302634:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1790778932.302639:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790778932.302652:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1790778932.302656:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:3.0:1790778932.302668:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1790778932.302673:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1790778932.302683:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1790778932.302697:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1790778932.303065:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1790778932.303076:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:3.0:1790778932.303078:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:3.0:1790778932.303104:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1790778932.303111:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790778932.303123:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1790778932.303128:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:3.0:1790778932.303141:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1790778932.303147:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1790778932.303159:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1790778932.303174:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1790778932.303188:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790778932.303190:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790778932.303194:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790778932.303236:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1790778932.303239:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790778932.306152:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1790778932.306201:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1790778932.306214:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1790778932.306538:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1790778932.306558:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1790778932.306570:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1790778932.306580:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790778932.306583:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790778932.306821:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1790778932.307468:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1790778932.307486:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1790778932.307498:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1790778932.307505:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790778932.307507:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790778932.307735:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1790778932.307759:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1790778932.307768:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1790778932.307995:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1790778932.308011:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1790778932.308024:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1790778932.308033:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790778932.308035:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790778932.308363:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1790778932.308382:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1790778932.308395:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1790778932.308654:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1790778932.308675:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1790778932.308690:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1790778932.308712:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790778932.308714:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790778932.309131:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1790778932.309152:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1790778932.309705:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1790778932.310258:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1790778932.310536:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1790778932.310556:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:1.0:1790778932.310572:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790778932.310592:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.310609:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936c8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c8e6 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.310617:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7742148000/0xb1aa4014e936c917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c910 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.310624:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c94f expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.310642:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c96b expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.310649:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c98e expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.310655:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c9b1 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.310662:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936c9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c9d4 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.310670:0:6518:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.310706:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936c9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c9d4 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.310720:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936c9e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c9d4 expref: 21 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.310734:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682048:0@lo:104: 00000100:00100000:1.0:1790778932.310795:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778932.311857:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c9b1 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.311870:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c9b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c9b1 expref: 21 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.311911:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682176:0@lo:104: 00000100:00100000:1.0:1790778932.311981:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778932.312177:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c98e expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.312187:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c98e expref: 21 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.312195:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682304:0@lo:104: 00000100:00100000:1.0:1790778932.312216:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778932.312711:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663682048 00000100:00100000:0.0:1790778932.312719:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663682048 00000100:00100000:2.0:1790778932.312802:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663682176 00000100:00100000:2.0:1790778932.312806:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663682176 00000100:00100000:2.0:1790778932.312826:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790778932.312833:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6518:x1877767663682048:12345-0@lo:104: 00010000:00010000:2.0:1790778932.312846:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.312916:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790778932.312922:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6518:x1877767663682048:12345-0@lo:104: Request processed in 89us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.312928:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790778932.312946:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790778932.312953:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6518:x1877767663682176:12345-0@lo:104: 00010000:00010000:2.0:1790778932.312960:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.312994:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790778932.312999:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6518:x1877767663682176:12345-0@lo:104: Request processed in 47us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.313014:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1790778932.313036:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790778932.313042:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.313049:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e6600 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778932.313054:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.313062:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778932.313069:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778932.313075:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778932.313103:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.313110:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778932.313127:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.313134:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c9e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.313147:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790778932.313150:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.313178:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742148200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778932.313181:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.313187:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778932.313194:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778932.313198:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778932.313213:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.313219:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778932.313232:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.313237:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936c9b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c9b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.313248:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778932.313249:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778932.313251:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778932.313259:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790778932.313628:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663682432:0@lo:103: 00000100:00100000:2.0:1790778932.313663:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.313705:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663682560:0@lo:103: 00000100:00100000:2.0:1790778932.313737:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778932.313801:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663682432 00000100:00100000:3.0:1790778932.313806:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663682432 00010000:00010000:3.0:1790778932.313829:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936c9e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c9d4 expref: 22 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778932.313856:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663682560 00000100:00100000:3.0:1790778932.313866:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663682560 00010000:00010000:3.0:1790778932.313900:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c9b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c9b1 expref: 23 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778932.313921:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790778932.313929:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+23:3651:x1877767663682432:12345-0@lo:103: 00010000:00010000:3.0:1790778932.313939:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778932.313943:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936c9e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c9d4 expref: 23 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.313952:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936c9e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c9d4 expref: 23 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.313968:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778932.314000:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+23:3651:x1877767663682432:12345-0@lo:103: Request processed in 74us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.314007:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790778932.314022:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790778932.314028:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+22:3649:x1877767663682560:12345-0@lo:103: 00010000:00010000:3.0:1790778932.314034:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778932.314038:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c9b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c9b1 expref: 22 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.314046:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c9b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c9b1 expref: 22 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.314055:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778932.314080:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+22:3649:x1877767663682560:12345-0@lo:103: Request processed in 52us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.314086:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790778932.314129:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663682560:0@lo:103: 00000100:00100000:3.0:1790778932.314152:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663682432:0@lo:103: 00010000:00010000:1.0:1790778932.314470:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c96b expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.314482:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c972 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c96b expref: 21 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.314490:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682688:0@lo:104: 00000100:00100000:1.0:1790778932.314515:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778932.314532:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c94f expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.314540:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c94f expref: 21 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.314547:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe27b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682816:0@lo:104: 00000100:00100000:1.0:1790778932.314566:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778932.314583:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7742148000/0xb1aa4014e936c917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c910 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.314590:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7742148000/0xb1aa4014e936c917 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c910 expref: 21 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.314610:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682944:0@lo:104: 00000100:00100000:1.0:1790778932.314635:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778932.314653:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936c8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c8e6 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.314661:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936c8ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c8e6 expref: 21 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.314669:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663683072:0@lo:104: 00000100:00100000:1.0:1790778932.314685:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702bc06c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790778932.314699:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936c9e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c9d4 expref: 21 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.314709:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682048:0@lo:104: 00010000:00010000:1.0:1790778932.314718:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701663800/0xb1aa4014e936c9b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c9b1 expref: 20 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.314726:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682176:0@lo:104: 00000100:00100000:2.0:1790778932.314791:0:6507:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790778932.314808:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.314819:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663682304 00000100:00100000:2.0:1790778932.314822:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663682304 00000100:00100000:2.0:1790778932.314844:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663682688 00000100:00100000:2.0:1790778932.314847:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663682688 00000100:00100000:2.0:1790778932.314856:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663682816 00000100:00100000:2.0:1790778932.314858:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663682816 00000100:00100000:2.0:1790778932.314865:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663682944 00000100:00100000:2.0:1790778932.314867:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663682944 00000100:00100000:2.0:1790778932.314874:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663683072 00000100:00100000:2.0:1790778932.314907:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663683072 00000100:00100000:2.0:1790778932.314937:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790778932.314943:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+7:6518:x1877767663682304:12345-0@lo:104: 00010000:00010000:2.0:1790778932.314955:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.315001:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790778932.315007:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+7:6518:x1877767663682304:12345-0@lo:104: Request processed in 65us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.315013:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790778932.315027:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790778932.315033:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+6:6518:x1877767663682688:12345-0@lo:104: 00010000:00010000:2.0:1790778932.315040:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.315068:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790778932.315072:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+6:6518:x1877767663682688:12345-0@lo:104: Request processed in 41us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.315084:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790778932.315097:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790778932.315102:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+5:6518:x1877767663682816:12345-0@lo:104: 00010000:00010000:2.0:1790778932.315109:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.315138:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790778932.315143:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+5:6518:x1877767663682816:12345-0@lo:104: Request processed in 42us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.315148:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790778932.315160:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790778932.317001:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7601e28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6518:x1877767663682944:12345-0@lo:104: 00010000:00010000:2.0:1790778932.317018:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.317083:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790778932.317088:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7601e28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:6518:x1877767663682944:12345-0@lo:104: Request processed in 1924us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.317096:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790778932.317140:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790778932.317148:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6518:x1877767663683072:12345-0@lo:104: 00010000:00010000:2.0:1790778932.317155:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.317193:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1790778932.317198:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:6518:x1877767663683072:12345-0@lo:104: Request processed in 53us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.317216:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790778932.317338:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682304:0@lo:104: 00000100:00100000:1.0:1790778932.317348:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682688:0@lo:104: 00000100:00100000:1.0:1790778932.317355:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe27b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682816:0@lo:104: 00000100:00100000:1.0:1790778932.317362:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663682944:0@lo:104: 00000100:00100000:1.0:1790778932.317369:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1877767663683072:0@lo:104: 00010000:00010000:1.0:1790778932.317398:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.317722:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790778932.317729:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.317737:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662c00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790778932.317741:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.317750:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778932.317757:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778932.317763:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778932.317792:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.317798:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790778932.317844:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663683200:0@lo:103: 00000100:00100000:1.0:1790778932.317903:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778932.318036:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318044:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7701662c00/0xb1aa4014e936c98e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c995 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318056:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790778932.318060:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318077:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790778932.318080:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318088:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778932.318093:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778932.318098:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778932.318113:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318119:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778932.318133:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318140:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936c96b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c972 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318150:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790778932.318154:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318159:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742148800 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790778932.318162:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318192:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778932.318198:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778932.318204:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778932.318218:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318224:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778932.318230:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318235:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936c94f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c956 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318247:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790778932.318250:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318256:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790778932.318258:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318265:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778932.318282:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778932.318293:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778932.318316:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318322:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790778932.318529:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790778932.318538:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663683584:0@lo:103: 00000100:00100000:1.0:1790778932.318582:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778932.318673:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318681:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7701663000/0xb1aa4014e936c910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c917 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318693:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778932.318695:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318700:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663a00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790778932.318703:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318710:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778932.318715:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778932.318719:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778932.318733:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318739:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778932.318751:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318758:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936c8e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c8ed expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.318771:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778932.318772:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778932.318774:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778932.318793:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663683456:0@lo:103: 00000100:00100000:0.0:1790778932.318819:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778932.318937:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663683712:0@lo:103: 00000100:00100000:0.0:1790778932.319102:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778932.319108:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663683328:0@lo:103: 00000100:00100000:0.0:1790778932.319130:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.319173:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663683200 00000100:00100000:2.0:1790778932.319181:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663683200 00010000:00010000:2.0:1790778932.319206:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c98e expref: 20 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778932.319229:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663683584 00000100:00100000:2.0:1790778932.319232:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663683584 00010000:00010000:2.0:1790778932.319243:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7742148000/0xb1aa4014e936c917 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c910 expref: 21 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778932.319253:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663683456 00000100:00100000:2.0:1790778932.319256:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663683456 00010000:00010000:2.0:1790778932.319265:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c94f expref: 22 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778932.319289:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790778932.319307:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+22:3650:x1877767663683200:12345-0@lo:103: 00010000:00010000:2.0:1790778932.319320:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778932.319325:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c98e expref: 22 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.319335:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c98e expref: 22 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.319348:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701663e00/0xb1aa4014e936c995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c98e expref: 22 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.319360:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778932.319390:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+21:3650:x1877767663683200:12345-0@lo:103: Request processed in 94us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.319405:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790778932.319422:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790778932.319429:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+20:3650:x1877767663683584:12345-0@lo:103: 00010000:00010000:2.0:1790778932.319436:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778932.319440:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7742148000/0xb1aa4014e936c917 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c910 expref: 20 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.319448:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7742148000/0xb1aa4014e936c917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c910 expref: 20 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.319457:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7742148000/0xb1aa4014e936c917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c910 expref: 20 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.319466:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778932.319488:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+19:3650:x1877767663683584:12345-0@lo:103: Request processed in 61us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.319494:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790778932.319531:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790778932.319537:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+18:3652:x1877767663683456:12345-0@lo:103: 00010000:00010000:2.0:1790778932.319543:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778932.319547:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c94f expref: 18 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.319554:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c94f expref: 18 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.319563:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662000/0xb1aa4014e936c956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c94f expref: 18 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.319579:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778932.319601:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+17:3652:x1877767663683456:12345-0@lo:103: Request processed in 65us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.319607:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1790778932.319813:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778932.320035:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663683456:0@lo:103: 00000100:00100000:0.0:1790778932.320069:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778932.320093:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663683584:0@lo:103: 00000100:00100000:0.0:1790778932.320102:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663683200:0@lo:103: 00000100:00100000:0.0:1790778932.320125:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663683328 00000100:00100000:0.0:1790778932.320129:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663683328 00010000:00010000:0.0:1790778932.320145:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c972 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c96b expref: 17 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778932.320174:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663683712 00000100:00100000:0.0:1790778932.320177:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663683712 00010000:00010000:0.0:1790778932.320189:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936c8ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c8e6 expref: 18 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778932.320202:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790778932.320216:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+18:3652:x1877767663683328:12345-0@lo:103: 00010000:00010000:0.0:1790778932.320225:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778932.320230:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c972 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c96b expref: 18 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.320238:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c96b expref: 18 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.320249:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894b200/0xb1aa4014e936c972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c96b expref: 18 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.320259:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778932.321595:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790778932.321613:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+17:3650:x1877767663683712:12345-0@lo:103: 00010000:00010000:1.0:1790778932.321628:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778932.321635:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936c8ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c8e6 expref: 17 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321649:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936c8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c8e6 expref: 17 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321664:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936c8ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c8e6 expref: 17 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321678:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321687:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321703:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321710:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321727:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321734:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321740:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790778932.321744:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321857:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321892:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.321904:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778932.321969:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+16:3650:x1877767663683712:12345-0@lo:103: Request processed in 363us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778932.321977:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+16:3652:x1877767663683328:12345-0@lo:103: Request processed in 1760us (2844us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778932.321978:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790778932.321990:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1790778932.322018:0:6518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.322027:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778932.322035:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663683328:0@lo:103: 00010000:00010000:1.0:1790778932.322036:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055ce600/0xb1aa4014e936c9f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790778932.322057:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790778932.322072:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663683712:0@lo:103: 00000100:00100000:1.0:1790778932.325657:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+14:9515:x1877767663681920:12345-0@lo:253: Request processed in 23893us (26022us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778932.325672:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790778932.325778:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603022a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663681920:0@lo:253: 10000000:01000000:2.0:1790778932.325796:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790778932.325800:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790778932.325802:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790778932.325803:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778932.325804:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1790778932.325805:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778932.325807:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778932.325808:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790778932.325810:0:9515:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790778932.325812:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778932.325813:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790778932.325835:0:9515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b760310d000 from lustre-OST0001 10000000:01000000:2.0:1790778932.325866:0:9515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790778932.325869:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790778932.325897:0:9515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b773059cd40 local copy 10000000:01000000:2.0:1790778932.325902:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790778932.325939:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.325951:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.325960:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778932.325979:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603022a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663683840:0@lo:101: 00000100:00100000:2.0:1790778932.326031:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.326069:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720167540 going to sleep for 11 seconds 00000100:00100000:0.0:1790778932.326250:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663683840 00000100:00100000:0.0:1790778932.326257:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663683840 00000100:00100000:0.0:1790778932.326310:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790778932.326319:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7703020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+14:9515:x1877767663683840:12345-0@lo:101: 00010000:00010000:0.0:1790778932.326331:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778932.326344:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ca05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936c9fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.326367:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ca05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936c9fe expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.326377:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ca05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c9fe expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.326393:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769200, rc 0) 00000100:00100000:0.0:1790778932.326439:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7703020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663683840:12345-0@lo:101: Request processed in 122us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778932.326444:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790778932.326894:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603022a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663683840:0@lo:101: 00010000:00010000:1.0:1790778932.326911:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.326921:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.327015:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663683968:0@lo:501: 00000100:00100000:1.0:1790778932.327048:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778932.327084:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702bc0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778932.327107:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663683968 00000100:00100000:2.0:1790778932.327113:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663683968 00000100:00100000:2.0:1790778932.327150:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790778932.327157:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663683968:12345-0@lo:501: 00000100:00100000:2.0:1790778932.327241:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663683968:12345-0@lo:501: Request processed in 84us (191us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790778932.327248:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790778932.331108:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663683968:0@lo:501: 10000000:01000000:1.0:1790778932.331138:0:9515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790778932.331190:0:9515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790778932.331198:0:9515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.331209:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.331215:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.331240:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790778932.331271:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b760310d000 10000000:01000000:1.0:1790778932.331276:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790778932.331296:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790778932.331309:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790778932.331314:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790778932.331316:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790778932.331347:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.331355:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.331366:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.331369:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778932.331378:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.331387:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684096:0@lo:101: 00010000:00010000:0.0:1790778932.331389:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e6600 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790778932.331405:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.331417:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778932.331425:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778932.331431:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1790778932.331450:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778932.331453:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.331461:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778932.331492:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.331493:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702bc0900 going to sleep for 11 seconds 00010000:00010000:0.0:1790778932.331504:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936c9fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1aa4014e936ca05 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.331529:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778932.331531:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778932.331533:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778932.331544:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778932.331557:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663684224:0@lo:103: 00000100:00100000:0.0:1790778932.331588:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.331715:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663684096 00000100:00100000:2.0:1790778932.331722:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663684096 00000100:00100000:2.0:1790778932.331775:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790778932.331784:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663684096:12345-0@lo:101: 00010000:00010000:2.0:1790778932.331797:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778932.331809:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936ca13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ca0c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.331832:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936ca13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ca0c expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.331843:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936ca13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca0c expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.331850:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e7200, rc 0) 00000100:00100000:2.0:1790778932.332002:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:9515:x1877767663684096:12345-0@lo:101: Request processed in 219us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.332009:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790778932.332133:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663684224 00000100:00100000:1.0:1790778932.332138:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663684224 00000100:00100000:1.0:1790778932.332179:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790778932.332185:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+16:3652:x1877767663684224:12345-0@lo:103: 00010000:00010000:1.0:1790778932.332194:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778932.332206:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ca05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936c9fe expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.332218:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778932.332265:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+15:3652:x1877767663684224:12345-0@lo:103: Request processed in 80us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778932.332271:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790778932.332311:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684096:0@lo:101: 00010000:00010000:1.0:1790778932.332335:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.332343:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778932.332372:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663684224:0@lo:103: 00000100:00100000:1.0:1790778932.332415:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684352:0@lo:501: 00000100:00100000:1.0:1790778932.332442:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778932.332470:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702bc0900 going to sleep for 11 seconds 00000100:00100000:0.0:1790778932.332497:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663684352 00000100:00100000:0.0:1790778932.332502:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663684352 00000100:00100000:0.0:1790778932.332534:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790778932.332541:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663684352:12345-0@lo:501: 00000100:00100000:0.0:1790778932.332647:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663684352:12345-0@lo:501: Request processed in 106us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778932.332655:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790778932.335451:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684352:0@lo:501: 00000100:00100000:2.0:1790778932.336055:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684480:0@lo:503: 00000100:00100000:2.0:1790778932.336138:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.336193:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7602785cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778932.336271:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663684480 00000100:00100000:1.0:1790778932.336279:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663684480 00000100:00100000:1.0:1790778932.336341:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790778932.336350:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663684480:12345-0@lo:503: 00000100:00100000:1.0:1790778932.336473:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663684480:12345-0@lo:503: Request processed in 124us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778932.336481:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790778932.336631:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684480:0@lo:503: 00000040:00080000:2.0:1790778932.336915:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790778932.336992:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684608:0@lo:502: 00000100:00100000:2.0:1790778932.337030:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.337051:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7602785cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778932.337540:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663684608 00000100:00100000:3.0:1790778932.337547:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663684608 00000100:00100000:3.0:1790778932.337589:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790778932.337598:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663684608:12345-0@lo:502: 00000100:00100000:3.0:1790778932.337691:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663684608:12345-0@lo:502: Request processed in 95us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.337699:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790778932.338492:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684608:0@lo:502: 00000040:00080000:2.0:1790778932.338754:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790778932.338784:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790778932.338798:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1790778932.338811:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1790778932.338824:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1790778932.338835:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1790778932.338863:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684736:0@lo:502: 00000100:00100000:2.0:1790778932.338957:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.338988:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7602785cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778932.340113:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663684736 00000100:00100000:1.0:1790778932.340122:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663684736 00000100:00100000:1.0:1790778932.340174:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790778932.340182:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663684736:12345-0@lo:502: 00000100:00100000:1.0:1790778932.340334:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663684736:12345-0@lo:502: Request processed in 152us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778932.340342:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790778932.340516:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684736:0@lo:502: 00000040:00080000:2.0:1790778932.340592:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790778932.340603:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1790778932.341126:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790778932.341135:0:9526:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1790778932.341142:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778932.341144:0:9526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790778932.341151:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790778932.341174:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b7603220000) 00000020:00000080:0.0:1790778932.341195:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790778932.341203:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790778932.341289:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b760310d000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790778932.341306:0:9526:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790778932.341313:0:9526:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb1aa4014e936ca21 00010000:00010000:2.0:1790778932.347539:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1790778932.348158:0:9526:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1790778932.360013:0:9526:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790778932.360373:0:9526:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1790778932.365915:0:9526:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1790778932.366105:0:9526:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1790778932.376484:0:9526:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1790778932.388616:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1790778932.388628:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790778932.388635:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778932.388637:0:9526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1790778932.388640:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790778932.388644:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778932.388645:0:9526:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790778932.388647:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790778932.388649:0:9526:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790778932.388677:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790778932.388680:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778932.388681:0:9526:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790778932.388684:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790778932.390694:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1790778932.390743:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790778932.390768:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.390782:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778932.390798:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b760310d000 from 1 10000000:01000000:2.0:1790778932.390801:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790778932.390836:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.390845:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.390857:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778932.390897:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684864:0@lo:101: 00000100:00100000:2.0:1790778932.394273:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.394346:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663684864 00000100:00100000:2.0:1790778932.394356:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663684864 00000100:00100000:2.0:1790778932.394416:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790778932.394425:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:9515:x1877767663684864:12345-0@lo:101: 00010000:00010000:2.0:1790778932.394443:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778932.394460:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ca2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ca28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.394489:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ca2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ca28 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.394501:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ca2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca28 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.394510:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6800, rc 0) 00000100:00100000:2.0:1790778932.394566:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:9515:x1877767663684864:12345-0@lo:101: Request processed in 141us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.394573:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790778932.394629:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7602785d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790778932.394651:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684864:0@lo:101: 00010000:00010000:2.0:1790778932.394667:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.394676:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778932.394773:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684992:0@lo:501: 00000100:00100000:2.0:1790778932.394799:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.394814:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7602785d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790778932.394829:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663684992 00000100:00100000:2.0:1790778932.394832:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663684992 00000100:00100000:2.0:1790778932.394855:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790778932.394861:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:9515:x1877767663684992:12345-0@lo:501: 00000100:00100000:2.0:1790778932.394973:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:9515:x1877767663684992:12345-0@lo:501: Request processed in 111us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.394980:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790778932.395008:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663684992:0@lo:501: 00000100:00100000:2.0:1790778932.395032:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685120:0@lo:503: 00000100:00100000:2.0:1790778932.395068:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.395086:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663685120 00000100:00100000:2.0:1790778932.395090:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663685120 00000100:00100000:2.0:1790778932.395109:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790778932.395120:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:9515:x1877767663685120:12345-0@lo:503: 00000100:00100000:2.0:1790778932.395187:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:9515:x1877767663685120:12345-0@lo:503: Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.395195:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790778932.395231:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773426d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778932.395243:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685120:0@lo:503: 00000040:00080000:2.0:1790778932.395466:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790778932.395532:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685248:0@lo:502: 00000100:00100000:2.0:1790778932.395562:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.395583:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663685248 00000100:00100000:2.0:1790778932.395586:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663685248 00000100:00100000:2.0:1790778932.395605:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790778932.395610:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:9515:x1877767663685248:12345-0@lo:502: 00000100:00100000:2.0:1790778932.395672:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:9515:x1877767663685248:12345-0@lo:502: Request processed in 60us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.395678:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790778932.395705:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b728b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778932.395716:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685248:0@lo:502: 00000040:00080000:2.0:1790778932.395865:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790778932.395914:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790778932.395933:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685376:0@lo:502: 00000100:00100000:2.0:1790778932.395962:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.395982:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663685376 00000100:00100000:2.0:1790778932.395985:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663685376 00000100:00100000:2.0:1790778932.396004:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790778932.396009:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:9515:x1877767663685376:12345-0@lo:502: 00000100:00100000:2.0:1790778932.396075:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:9515:x1877767663685376:12345-0@lo:502: Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.396082:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790778932.396113:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b728b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778932.396123:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685376:0@lo:502: 00000040:00080000:2.0:1790778932.396154:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1790778932.396162:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790778932.401069:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778932.401081:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778932.401084:0:9530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790778932.401101:0:9530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b760310d000 00000020:00000080:0.0:1790778932.401104:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790778932.401117:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778932.401120:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778932.401121:0:9530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790778932.401124:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790778932.401251:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790778932.401287:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790778932.401318:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.401330:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778932.401380:0:9515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790778932.401383:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b760310d000 10000000:01000000:3.0:1790778932.401386:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b760310d000 10000000:01000000:3.0:1790778932.401389:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790778932.401395:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b760310d000 from 1 10000000:01000000:3.0:1790778932.401398:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790778932.401433:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.401442:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.401453:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778932.401475:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685504:0@lo:101: 00000100:00100000:3.0:1790778932.401538:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778932.401579:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71180 going to sleep for 11 seconds 00000100:00100000:2.0:1790778932.401670:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663685504 00000100:00100000:2.0:1790778932.401677:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663685504 00000100:00100000:2.0:1790778932.401725:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790778932.401734:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:9515:x1877767663685504:12345-0@lo:101: 00010000:00010000:2.0:1790778932.401747:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778932.401759:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e6600/0xb1aa4014e936ca3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ca36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.401780:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6600/0xb1aa4014e936ca3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ca36 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.401790:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e6600/0xb1aa4014e936ca3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca36 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.401797:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6600, rc 0) 00000100:00100000:2.0:1790778932.401844:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:9515:x1877767663685504:12345-0@lo:101: Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.401850:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790778932.402023:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685504:0@lo:101: 00010000:00010000:3.0:1790778932.402037:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.402044:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778932.402132:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685632:0@lo:501: 00000100:00100000:3.0:1790778932.402158:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778932.402184:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71180 going to sleep for 11 seconds 00000100:00100000:2.0:1790778932.402230:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663685632 00000100:00100000:2.0:1790778932.402234:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663685632 00000100:00100000:2.0:1790778932.402295:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790778932.402319:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:9515:x1877767663685632:12345-0@lo:501: 00000100:00100000:2.0:1790778932.402423:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:9515:x1877767663685632:12345-0@lo:501: Request processed in 105us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.402430:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790778932.402486:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685632:0@lo:501: 00000100:00100000:3.0:1790778932.402512:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685760:0@lo:503: 00000100:00100000:3.0:1790778932.402549:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778932.408968:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663685760 00000100:00100000:0.0:1790778932.408981:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663685760 00000100:00100000:0.0:1790778932.409026:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790778932.409035:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:9515:x1877767663685760:12345-0@lo:503: 00000100:00100000:0.0:1790778932.409173:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:9515:x1877767663685760:12345-0@lo:503: Request processed in 138us (6622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778932.409181:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790778932.412904:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71180 going to sleep for 11 seconds 00000100:00100000:2.0:1790778932.412947:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685760:0@lo:503: 00000040:00080000:2.0:1790778932.413345:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790778932.413427:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685888:0@lo:502: 00000100:00100000:2.0:1790778932.413503:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.413574:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b728e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790778932.414512:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663685888 00000100:00100000:0.0:1790778932.414521:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663685888 00000100:00100000:0.0:1790778932.414610:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790778932.414620:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:9515:x1877767663685888:12345-0@lo:502: 00000100:00100000:0.0:1790778932.414755:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:9515:x1877767663685888:12345-0@lo:502: Request processed in 136us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778932.414764:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790778932.414912:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663685888:0@lo:502: 00000040:00080000:1.0:1790778932.415142:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790778932.415175:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790778932.415188:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790778932.415200:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790778932.415227:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790778932.415255:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790778932.415269:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790778932.415282:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790778932.415294:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790778932.415320:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790778932.415334:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790778932.415346:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790778932.415358:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790778932.415371:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790778932.415384:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790778932.415396:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790778932.415408:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790778932.415421:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790778932.415433:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790778932.415459:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790778932.415473:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790778932.415485:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790778932.415497:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790778932.415509:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790778932.415523:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1790778932.415535:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1790778932.415546:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1790778932.415556:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1790778932.415568:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1790778932.415580:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1790778932.415593:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1790778932.415607:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1790778932.415618:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1790778932.415630:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1790778932.415654:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1790778932.415679:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1790778932.415694:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1790778932.415706:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1790778932.415716:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1790778932.415728:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1790778932.415740:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1790778932.415754:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1790778932.415768:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1790778932.415780:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1790778932.415791:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1790778932.415803:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1790778932.415833:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663686016:0@lo:502: 00000100:00100000:1.0:1790778932.415902:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778932.416505:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702bc00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778932.416638:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663686016 00000100:00100000:2.0:1790778932.416646:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663686016 00000100:00100000:2.0:1790778932.416682:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790778932.416691:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:9515:x1877767663686016:12345-0@lo:502: 00000100:00100000:2.0:1790778932.416808:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:9515:x1877767663686016:12345-0@lo:502: Request processed in 118us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.416815:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790778932.416864:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663686016:0@lo:502: 00000040:00080000:2.0:1790778932.416935:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1790778932.416946:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1790778932.417776:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790778932.417790:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b773b7819c0) 00000020:00000080:3.0:1790778932.417813:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1790778932.418104:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b760310d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790778932.418108:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b760310d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790778932.418111:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b760310d000 3 00010000:00080000:3.0:1790778932.418137:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7601e10800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1790778932.420133:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1790778932.420569:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790778932.420611:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790778932.420622:0:9531:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb1aa4014e936ca4b 00000100:00080000:3.0:1790778932.420632:0:9531:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790778932.420641:0:9531:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b7601e10800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790778932.420674:0:9531:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7704143100 x1877767663686144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790778932.420788:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663686144:0@lo:38: 00000100:00100000:1.0:1790778932.420849:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.420955:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663686144 00000100:00100000:2.0:1790778932.420962:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663686144 00000100:00100000:2.0:1790778932.420992:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790778932.421000:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663686144:12345-0@lo:38: 00010000:00080000:2.0:1790778932.421022:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1790778932.421047:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb1aa4014e936ca52 00000004:00100000:2.0:1790778932.421068:0:6523:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790778932.421097:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9b760310b000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1790778932.421163:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790778932.422323:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877767663686144:12345-0@lo:38: Request processed in 1320us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.422333:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790778932.422449:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663686656:0@lo:400: 00000100:00100000:2.0:1790778932.422486:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.422508:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663687168:0@lo:400: 00000100:00100000:2.0:1790778932.422530:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.422549:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790778932.422554:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663686272:0@lo:400: 00000100:00100000:2.0:1790778932.422575:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.422589:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663686784:0@lo:400: 00000100:00100000:2.0:1790778932.422608:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.422628:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663686400:0@lo:400: 00000100:00100000:2.0:1790778932.422650:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.422665:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663686912:0@lo:400: 00000100:00100000:2.0:1790778932.422684:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.422698:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790778932.422703:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663686528:0@lo:400: 00000100:00100000:2.0:1790778932.422722:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.422732:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663687040:0@lo:400: 00000100:00100000:2.0:1790778932.422750:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.422775:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663686656 00000100:00100000:2.0:1790778932.422781:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663686656 00000100:00100000:2.0:1790778932.422805:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663686400 00000100:00100000:2.0:1790778932.422814:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663686400 00000100:00100000:2.0:1790778932.422830:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790778932.422837:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663686656:12345-0@lo:400: 00000100:00100000:2.0:1790778932.422897:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663686656:12345-0@lo:400: Request processed in 59us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.422904:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790778932.422918:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790778932.422925:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663686400:12345-0@lo:400: 00000100:00100000:2.0:1790778932.422955:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663686400:12345-0@lo:400: Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.422961:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790778932.422977:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663687168 00000100:00100000:2.0:1790778932.422981:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663687168 00000100:00100000:2.0:1790778932.423006:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663687040 00000100:00100000:2.0:1790778932.423009:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663687040 00000100:00100000:2.0:1790778932.423026:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778932.423032:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663687168:12345-0@lo:400: 00000100:00100000:2.0:1790778932.423061:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663687168:12345-0@lo:400: Request processed in 28us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.423067:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778932.423077:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790778932.423083:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663687040:12345-0@lo:400: 00000100:00100000:2.0:1790778932.423107:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663687040:12345-0@lo:400: Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.423112:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790778932.423129:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663686272 00000100:00100000:2.0:1790778932.423132:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663686272 00000100:00100000:2.0:1790778932.423146:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663686784 00000100:00100000:2.0:1790778932.423154:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663686784 00000100:00100000:2.0:1790778932.423169:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663686912 00000100:00100000:2.0:1790778932.423172:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663686912 00000100:00100000:2.0:1790778932.423183:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663686528 00000100:00100000:2.0:1790778932.423185:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663686528 00000100:00100000:2.0:1790778932.423936:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790778932.423946:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663686272:12345-0@lo:400: 00000100:00100000:2.0:1790778932.423999:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663686272:12345-0@lo:400: Request processed in 56us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.424006:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790778932.424020:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790778932.424026:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663686784:12345-0@lo:400: 00000100:00100000:2.0:1790778932.424054:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663686784:12345-0@lo:400: Request processed in 29us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.424060:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790778932.424070:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790778932.424076:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663686912:12345-0@lo:400: 00000100:00100000:2.0:1790778932.424104:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663686912:12345-0@lo:400: Request processed in 29us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.424110:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790778932.424122:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790778932.424128:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663686528:12345-0@lo:400: 00000100:00100000:2.0:1790778932.424174:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663686528:12345-0@lo:400: Request processed in 46us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.424180:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1790778932.427064:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790778932.427073:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790778932.427085:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790778932.427147:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603021c00 x1877767663686528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778932.428369:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663686528:0@lo:400: 00010000:00080000:2.0:1790778932.428406:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603023800 x1877767663687040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778932.428417:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663687040:0@lo:400: 00000100:00100000:2.0:1790778932.428430:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663686400:0@lo:400: 00010000:00080000:2.0:1790778932.428441:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603021f80 x1877767663686912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778932.428448:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663686912:0@lo:400: 00010000:00080000:2.0:1790778932.428500:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603023480 x1877767663686272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778932.428509:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663686272:0@lo:400: 00010000:00080000:2.0:1790778932.428521:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603020700 x1877767663686784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778932.428529:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663686784:0@lo:400: 00000100:00100000:2.0:1790778932.428543:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663686656:0@lo:400: 00010000:00080000:2.0:1790778932.428553:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603022680 x1877767663687168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778932.428561:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663687168:0@lo:400: 00010000:00080000:1.0:1790778932.429067:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7704143100 x1877767663686144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790778942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778932.429077:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790778932.429085:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1790778932.429093:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790778932.429099:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790778932.429102:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7601e10800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790778932.429108:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663686144:0@lo:38: 00000020:01000004:2.0:1790778932.429654:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790778932.429676:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9b773409b380) 00000020:00000080:2.0:1790778932.429700:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1790778932.429779:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b760310d000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790778932.429784:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b760310d000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790778932.429787:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b760310d000 3 00010000:00080000:2.0:1790778932.429817:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b773f472000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.103@tcp at head 00000100:00100000:1.0:1790778932.430408:0:9533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1877767663687296:0@lo:901: 00000100:00100000:1.0:1790778932.430468:0:9533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778932.430503:0:9533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702bc0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790778932.430584:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663687296 00000100:00100000:3.0:1790778932.430593:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663687296 00000100:00100000:3.0:1790778932.430652:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790778932.430660:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1877767663687296:12345-0@lo:901: 00000100:00100000:3.0:1790778932.430759:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1877767663687296:12345-0@lo:901: Request processed in 99us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.430767:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790778932.430919:0:9533:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b772fe26680 x1877767663687296/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790778948 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778932.430931:0:9533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1877767663687296:0@lo:901: 00000100:00080000:1.0:1790778932.431414:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790778932.432678:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1790778932.440678:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1790778932.440727:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790778932.440740:0:9531:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb1aa4014e936ca60 00000100:00080000:2.0:1790778932.440751:0:9531:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790778932.440763:0:9531:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b773f472000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790778932.440799:0:9531:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773b769180 x1877767663687424/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790778932.440825:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1790778932.440863:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1877767663687424:0@lo:38: 00000100:00100000:2.0:1790778932.440940:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.441593:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663687424 00000100:00100000:2.0:1790778932.441601:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663687424 00000100:00100000:2.0:1790778932.441633:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790778932.441640:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663687424:12345-0@lo:38: 00010000:00080000:2.0:1790778932.441665:0:6525:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1790778932.441697:0:6525:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb1aa4014e936ca67 00000004:00100000:2.0:1790778932.441710:0:6525:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790778932.441739:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9b7601e13000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790778932.441802:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877767663687424:12345-0@lo:38: Request processed in 161us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.441810:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790778932.442324:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b769180 x1877767663687424/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790778942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778932.442335:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790778932.442342:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1790778932.442349:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790778932.442353:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790778932.442355:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773f472000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790778932.442362:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1877767663687424:0@lo:38: 00000040:00080000:2.0:1790778932.442680:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1790778932.442798:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1790778932.442828:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790778932.442849:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.442860:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790778932.443031:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790778932.443034:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790778932.443036:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790778932.443037:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790778932.443038:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790778932.443040:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790778932.443041:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790778932.443043:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790778932.443044:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790778932.443046:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790778932.443048:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790778932.443052:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1790778932.443054:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790778932.443056:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790778932.443057:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790778932.443062:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790778932.443063:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790778932.443064:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790778932.443065:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790778932.443066:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790778932.443067:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790778932.443068:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790778932.443069:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790778932.443086:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790778932.443098:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663687552:0@lo:253: 00000100:00100000:1.0:1790778932.443141:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778932.443238:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702bc0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790778932.443471:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663687552 00000100:00100000:2.0:1790778932.443477:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663687552 00000100:00100000:2.0:1790778932.443550:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790778932.443559:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:9515:x1877767663687552:12345-0@lo:253: 20000000:01000000:2.0:1790778932.443583:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790778932.443596:0:6518:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790778932.451307:0:6518:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790778932.451330:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1790778932.451427:0:6539:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790778932.451432:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790778932.451452:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.451470:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c95d expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.451478:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c9a3 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.451499:0:6539:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.451536:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c9a3 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.451551:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c9aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c9a3 expref: 17 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778932.451564:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663687680:0@lo:104: 00000100:00100000:0.0:1790778932.451625:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778932.451679:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c95d expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.451687:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c964 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c95d expref: 17 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778932.451695:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663687808:0@lo:104: 00000100:00100000:0.0:1790778932.451718:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778932.451738:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854b300 going to sleep for 11 seconds 00000100:00100000:1.0:1790778932.451803:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663687680 00000100:00100000:1.0:1790778932.451810:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663687680 00000100:00100000:1.0:1790778932.451845:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663687808 00000100:00100000:1.0:1790778932.451848:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663687808 00000100:00100000:1.0:1790778932.451863:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790778932.451871:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+4:6539:x1877767663687680:12345-0@lo:104: 00010000:00010000:1.0:1790778932.451919:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.451973:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790778932.451979:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+4:6539:x1877767663687680:12345-0@lo:104: Request processed in 110us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778932.451986:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790778932.452004:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790778932.452010:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:6539:x1877767663687808:12345-0@lo:104: 00010000:00010000:1.0:1790778932.452018:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.452050:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790778932.452055:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:6539:x1877767663687808:12345-0@lo:104: Request processed in 46us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778932.452068:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790778932.452351:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:9515:x1877767663687552:12345-0@lo:253: Request processed in 8791us (9208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.452358:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790778932.452446:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3110940-f102-4234-a689-7d64ccf7427e:9515:1877767663687552:0@lo:253: 10000000:01000000:1.0:1790778932.452457:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790778932.452462:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790778932.452463:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790778932.452465:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790778932.452466:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790778932.452467:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790778932.452468:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790778932.452469:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790778932.452471:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790778932.452472:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790778932.452474:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790778932.452475:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790778932.452489:0:9515:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1790778932.454000:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790778932.454013:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.454024:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742149200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790778932.454028:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.454038:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778932.454063:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778932.454069:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778932.454114:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.454121:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778932.454148:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.454156:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936c9a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c9aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.454182:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778932.454186:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.454191:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b600 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790778932.454194:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.454201:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778932.454206:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778932.454212:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778932.454234:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.454240:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778932.454251:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.454257:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936c95d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c964 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.454271:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778932.454272:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778932.454274:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778932.454327:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663687680:0@lo:104: 00000100:00100000:0.0:1790778932.454338:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1877767663687808:0@lo:104: 00010000:00010000:0.0:1790778932.454359:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778932.454413:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790778932.454431:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663688064:0@lo:103: 00000100:00100000:2.0:1790778932.454483:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.454542:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790778932.454551:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663687936:0@lo:103: 00000100:00100000:2.0:1790778932.454574:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778932.454603:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663688064 00000100:00100000:2.0:1790778932.454610:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663688064 00010000:00010000:2.0:1790778932.454635:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c964 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c95d expref: 17 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778932.454660:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663687936 00000100:00100000:2.0:1790778932.454663:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663687936 00010000:00010000:2.0:1790778932.454674:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c9aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c9a3 expref: 18 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778932.454695:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790778932.454703:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+18:3650:x1877767663688064:12345-0@lo:103: 00010000:00010000:2.0:1790778932.454724:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778932.454729:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c964 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c95d expref: 18 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454738:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c95d expref: 18 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454751:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936c964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c95d expref: 18 pid: 6517 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454762:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778932.454793:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+17:3650:x1877767663688064:12345-0@lo:103: Request processed in 91us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.454800:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790778932.454814:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790778932.454820:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+16:3651:x1877767663687936:12345-0@lo:103: 00010000:00010000:2.0:1790778932.454828:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778932.454832:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c9aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c9a3 expref: 16 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454840:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c9a3 expref: 16 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454849:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662800/0xb1aa4014e936c9aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c9a3 expref: 16 pid: 6518 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454859:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454866:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790778932.454913:0:7465:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013751976s 00010000:00010000:2.0:1790778932.454918:0:7465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454925:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454931:0:7465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454937:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454942:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790778932.454946:0:7465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454953:0:7465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454966:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.454974:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778932.455002:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3110940-f102-4234-a689-7d64ccf7427e+15:3651:x1877767663687936:12345-0@lo:103: Request processed in 182us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.455009:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790778932.455040:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663688064:0@lo:103: 00000100:00100000:2.0:1790778932.455060:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663687936:0@lo:103: 00010000:00010000:2.0:1790778932.455083:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.455090:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.455096:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca6e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.456215:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1790778932.464063:0:9515:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1790778932.464235:0:9515:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1790778932.464457:0:9515:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1790778932.464651:0:9515:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1790778932.464867:0:9515:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1790778932.465105:0:9515:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1790778932.466539:0:9515:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1790778932.480816:0:9515:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1790778932.480827:0:9515:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1790778932.480873:0:9515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790778932.480934:0:9515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790778932.480953:0:9515:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1790778932.480986:0:9515:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1790778932.481983:0:9515:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778932.482192:0:9515:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1790778933.162572:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790778933.365231:0:9587:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778933.365448:0:9587:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790778933.866263:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663688192:0@lo:41: 00000100:00100000:2.0:1790778933.866346:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778933.866392:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663688192 00000100:00100000:0.0:1790778933.866401:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663688192 00000100:00100000:0.0:1790778933.866449:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790778933.866457:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663688192:12345-0@lo:41: 00000004:00000024:0.0:1790778933.866488:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1790778933.866533:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663688192:12345-0@lo:41: Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778933.866539:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790778933.866634:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663688192:0@lo:41: 00010000:00010000:1.0:1790778934.188322:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778935.209962:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778935.400342:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663688320:0@lo:13: 00000100:00100000:0.0:1790778935.400433:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778935.400467:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663688320 00000100:00100000:2.0:1790778935.400476:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663688320 00000100:00100000:0.0:1790778935.400491:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778935.400499:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663688448:0@lo:13: 00000100:00100000:0.0:1790778935.400528:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778935.400529:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790778935.400542:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663688320:12345-0@lo:13: 00002000:00000024:2.0:1790778935.400568:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1790778935.400614:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778935.400621:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663688320:12345-0@lo:13: Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778935.400628:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790778935.400643:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663688448 00000100:00100000:2.0:1790778935.400646:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663688448 00010000:00080000:0.0:1790778935.400730:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b76bb80 x1877767663688320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778935.400748:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663688320:0@lo:13: 00000100:00100000:2.0:1790778935.400803:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790778935.400809:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663688448:12345-0@lo:13: 00002000:00000024:2.0:1790778935.400818:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778935.400850:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663688448:12345-0@lo:13: Request processed in 41us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778935.400873:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790778935.400963:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b769c00 x1877767663688448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778935.400975:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663688448:0@lo:13: 00000100:00080000:1.0:1790778935.401503:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790778936.232048:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778936.937106:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790778936.937133:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663688576:0@lo:41: 00000100:00100000:1.0:1790778936.937200:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778936.937299:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663688576 00000100:00100000:0.0:1790778936.937307:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663688576 00000100:00100000:0.0:1790778936.937353:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790778936.937363:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663688576:12345-0@lo:41: 00000004:00000024:0.0:1790778936.937395:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1790778936.937452:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663688576:12345-0@lo:41: Request processed in 90us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778936.937458:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790778936.937593:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663688576:0@lo:41: 00010000:00010000:0.0:1790778937.255987:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778937.452496:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663688832:0@lo:400: 00000100:00100000:0.0:1790778937.452564:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778937.452613:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663689344:0@lo:400: 00000100:00100000:0.0:1790778937.452639:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778937.452677:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663689088:0@lo:400: 00000100:00100000:1.0:1790778937.452796:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663688704:0@lo:400: 00000100:00100000:1.0:1790778937.452840:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778937.452870:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663689216:0@lo:400: 00000100:00100000:1.0:1790778937.452918:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778937.452935:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663689728:0@lo:400: 00000100:00100000:1.0:1790778937.452958:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778937.452992:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663688960:0@lo:400: 00000100:00100000:1.0:1790778937.453015:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778937.453034:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663689472:0@lo:400: 00000100:00100000:1.0:1790778937.453062:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663689728 00000100:00100000:1.0:1790778937.453069:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663689728 00000100:00100000:3.0:1790778937.453162:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663688704 00000100:00100000:3.0:1790778937.453167:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663688704 00000100:00100000:3.0:1790778937.453201:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790778937.453209:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:3650:x1877767663688704:12345-0@lo:400: 00000100:00100000:3.0:1790778937.453273:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+15:3650:x1877767663688704:12345-0@lo:400: Request processed in 65us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.453282:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790778937.453313:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663689216 00000100:00100000:3.0:1790778937.453317:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663689216 00000100:00100000:3.0:1790778937.453334:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663688960 00000100:00100000:3.0:1790778937.453336:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663688960 00000100:00100000:3.0:1790778937.453348:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790778937.453354:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663689216:12345-0@lo:400: 00000100:00100000:3.0:1790778937.453388:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663689216:12345-0@lo:400: Request processed in 34us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.453395:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790778937.453406:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790778937.453412:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663688960:12345-0@lo:400: 00000100:00100000:3.0:1790778937.453455:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663688960:12345-0@lo:400: Request processed in 43us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.453461:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790778937.453495:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663688704:0@lo:400: 00000100:00100000:3.0:1790778937.453507:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663689216:0@lo:400: 00000100:00100000:0.0:1790778937.454724:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663689856:0@lo:400: 00000100:00100000:1.0:1790778937.454736:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790778937.454751:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663689728:12345-0@lo:400: 00000100:00100000:0.0:1790778937.454792:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778937.454961:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663689728:12345-0@lo:400: Request processed in 211us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778937.454970:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790778937.455004:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790778937.455034:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603842d80 x1877767663689728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778937.455060:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663689728:0@lo:400: 00000100:00100000:2.0:1790778937.455118:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663688832 00000100:00100000:2.0:1790778937.455125:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663688832 00000100:00100000:0.0:1790778937.455162:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663689344 00000100:00100000:0.0:1790778937.455167:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663689344 00000100:00100000:0.0:1790778937.455359:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663689856 00000100:00100000:0.0:1790778937.455364:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663689856 00000100:00100000:1.0:1790778937.455452:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790778937.455463:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663689344:12345-0@lo:400: 00000100:00100000:1.0:1790778937.455507:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663689344:12345-0@lo:400: Request processed in 47us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778937.455514:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790778937.459641:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790778937.459661:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663688832:12345-0@lo:400: 00000100:00080000:0.0:1790778937.459742:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778937.459846:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778937.459902:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663688832:12345-0@lo:400: Request processed in 250us (7337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.459911:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790778937.459926:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663689600:0@lo:400: 00000100:00100000:2.0:1790778937.459932:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663689088 00000100:00100000:2.0:1790778937.459940:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663689088 00000100:00100000:2.0:1790778937.459964:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790778937.459976:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663689856:12345-0@lo:400: 00000100:00100000:0.0:1790778937.459978:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778937.460024:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778937.460032:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663689856:12345-0@lo:400: Request processed in 60us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.460039:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790778937.460055:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663689472 00000100:00100000:2.0:1790778937.460059:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663689472 00000100:00100000:0.0:1790778937.460059:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663689984:0@lo:400: 00000100:00100000:2.0:1790778937.460092:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790778937.460097:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778937.460101:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663689088:12345-0@lo:400: 00000100:00100000:0.0:1790778937.460133:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663688960:0@lo:400: 00010000:00080000:0.0:1790778937.460171:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041ac380 x1877767663688832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778937.460183:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663688832:0@lo:400: 00010000:00080000:0.0:1790778937.460195:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7f6680 x1877767663689344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778937.460204:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663689344:0@lo:400: 00000100:00100000:2.0:1790778937.460220:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663689088:12345-0@lo:400: Request processed in 120us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.460226:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790778937.460236:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663689984 00000100:00100000:2.0:1790778937.460239:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663689984 00000100:00100000:2.0:1790778937.460254:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790778937.460270:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663689472:12345-0@lo:400: 00000100:00100000:2.0:1790778937.460306:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663689472:12345-0@lo:400: Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.460320:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790778937.460333:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790778937.460339:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663689984:12345-0@lo:400: 00000100:00100000:2.0:1790778937.460368:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663689984:12345-0@lo:400: Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.460373:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790778937.460393:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663689600 00000100:00100000:2.0:1790778937.460396:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663689600 00000100:00100000:2.0:1790778937.460423:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790778937.460423:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603840a80 x1877767663689856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778937.460433:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663689600:12345-0@lo:400: 00000100:00100000:2.0:1790778937.460463:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663689600:12345-0@lo:400: Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.460469:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790778937.460489:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790778937.460493:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790778937.460506:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663689856:0@lo:400: 00010000:00080000:2.0:1790778937.460515:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041ace00 x1877767663689088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778937.460528:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663689088:0@lo:400: 00010000:00080000:2.0:1790778937.460540:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603841880 x1877767663689600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778937.460549:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663689600:0@lo:400: 00010000:00080000:2.0:1790778937.460578:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603841180 x1877767663689472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778937.460585:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663689472:0@lo:400: 00010000:00080000:2.0:1790778937.460596:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603842a00 x1877767663689984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778937.460612:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663689984:0@lo:400: 00000001:02000400:0.0:1790778937.871846:0:9876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790778938.280228:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790778938.641311:0:9928:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790778938.641544:0:9928:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790778938.986600:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790778938.986625:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663690112:0@lo:41: 00000100:00100000:1.0:1790778938.986689:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778938.986750:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663690112 00000100:00100000:2.0:1790778938.986767:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663690112 00000100:00100000:2.0:1790778938.986818:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790778938.986827:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663690112:12345-0@lo:41: 00000004:00000024:2.0:1790778938.986860:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1790778938.986932:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663690112:12345-0@lo:41: Request processed in 106us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778938.986940:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790778938.987402:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663690112:0@lo:41: 00010000:00010000:0.0:1790778939.304319:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778940.331003:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778940.521063:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663690240:0@lo:13: 00000100:00100000:1.0:1790778940.521063:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663690368:0@lo:13: 00000100:00100000:2.0:1790778940.521168:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778940.521317:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663690240 00000100:00100000:2.0:1790778940.521327:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663690240 00000100:00100000:2.0:1790778940.521390:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790778940.521401:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663690240:12345-0@lo:13: 00002000:00000024:2.0:1790778940.521439:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778940.521492:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663690240:12345-0@lo:13: Request processed in 93us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778940.521513:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790778940.522656:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790778940.522788:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778940.522898:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663690368 00000100:00100000:2.0:1790778940.522907:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663690368 00000100:00100000:2.0:1790778940.522961:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790778940.522973:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663690368:12345-0@lo:13: 00002000:00000024:2.0:1790778940.523017:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778940.523143:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663690368:12345-0@lo:13: Request processed in 173us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778940.523152:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1790778940.523175:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790778940.523220:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b769c00 x1877767663690240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778940.523258:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663690240:0@lo:13: 00010000:00080000:3.0:1790778940.524855:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b772fe24a80 x1877767663690368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778940.524906:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663690368:0@lo:13: 00000020:00000004:3.0:1790778941.175314:0:10030:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790778941.175613:0:10030:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790778941.351981:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790778941.543934:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790778941.543941:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b77344a6000 from 39 10000000:01000000:0.0:1790778941.543954:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790778941.543996:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.544012:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.544024:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778941.544056:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663690496:0@lo:101: 00000100:00100000:0.0:1790778941.544122:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.544189:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790778941.544319:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663690496 00000100:00100000:2.0:1790778941.544328:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663690496 00000100:00100000:2.0:1790778941.544376:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790778941.544385:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663690496:12345-0@lo:101: 00010000:00010000:2.0:1790778941.544399:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778941.544412:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ca7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ca75 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.544435:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ca7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ca75 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.544445:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ca7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca75 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.544453:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6c00, rc 0) 00000100:00100000:2.0:1790778941.544499:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663690496:12345-0@lo:101: Request processed in 116us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778941.544506:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790778941.544698:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663690496:0@lo:101: 00010000:00010000:0.0:1790778941.544713:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.544722:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778941.544781:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663690624:0@lo:501: 00000100:00100000:0.0:1790778941.544898:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.544920:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790778941.544973:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663690624 00000100:00100000:1.0:1790778941.544978:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663690624 00000100:00100000:1.0:1790778941.545011:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790778941.545018:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663690624:12345-0@lo:501: 00000100:00100000:1.0:1790778941.545217:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663690624:12345-0@lo:501: Request processed in 199us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778941.545225:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790778941.545395:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663690624:0@lo:501: 00000100:00100000:0.0:1790778941.545420:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663690752:0@lo:503: 00000100:00100000:0.0:1790778941.545462:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.545490:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790778941.545607:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663690752 00000100:00100000:1.0:1790778941.545612:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663690752 00000100:00100000:1.0:1790778941.545682:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790778941.545690:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663690752:12345-0@lo:503: 00000100:00100000:1.0:1790778941.545779:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663690752:12345-0@lo:503: Request processed in 90us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778941.545786:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790778941.545858:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663690752:0@lo:503: 00000100:00100000:0.0:1790778941.546117:0:10049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10049:1877767663690880:0@lo:502: 00000100:00100000:0.0:1790778941.546151:0:10049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.552717:0:10049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f540 going to sleep for 11 seconds 00000100:00100000:2.0:1790778941.554309:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663690880 00000100:00100000:2.0:1790778941.554320:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663690880 00000100:00100000:2.0:1790778941.554380:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790778941.554389:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:10049:x1877767663690880:12345-0@lo:502: 00000100:00100000:2.0:1790778941.554558:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:10049:x1877767663690880:12345-0@lo:502: Request processed in 170us (8405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778941.554566:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790778941.554710:0:10049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10049:1877767663690880:0@lo:502: 00000100:00100000:1.0:1790778941.554777:0:10049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10049:1877767663691008:0@lo:502: 00000100:00100000:1.0:1790778941.554819:0:10049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.554908:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663691008 00000100:00100000:1.0:1790778941.554912:0:10049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.554913:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663691008 00000100:00100000:0.0:1790778941.554971:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790778941.554980:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:10049:x1877767663691008:12345-0@lo:502: 00000100:00100000:0.0:1790778941.555052:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:10049:x1877767663691008:12345-0@lo:502: Request processed in 73us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.555059:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790778941.555760:0:10049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10049:1877767663691008:0@lo:502: 00000040:00080000:1.0:1790778941.555785:0:10049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1790778941.556059:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1790778941.556079:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790778941.556088:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.556099:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778941.556108:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790778941.556111:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1790778941.556114:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790778941.556140:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.556149:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.556159:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778941.556363:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663691136:0@lo:101: 00000100:00100000:0.0:1790778941.556404:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.556442:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f180 going to sleep for 11 seconds 00000100:00100000:2.0:1790778941.556509:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663691136 00000100:00100000:2.0:1790778941.556515:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663691136 00000100:00100000:2.0:1790778941.556583:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790778941.556592:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663691136:12345-0@lo:101: 00010000:00010000:2.0:1790778941.556602:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778941.556614:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936ca8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ca83 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.556634:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936ca8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ca83 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.556644:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936ca8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca83 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.556651:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6a00, rc 0) 00000100:00100000:2.0:1790778941.556695:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663691136:12345-0@lo:101: Request processed in 104us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778941.556701:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790778941.556760:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663691136:0@lo:101: 00010000:00010000:1.0:1790778941.556772:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778941.556780:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778941.556837:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663691264:0@lo:501: 00000100:00100000:1.0:1790778941.556862:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778941.559511:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.559525:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663691264 00000100:00100000:0.0:1790778941.559536:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663691264 00000100:00100000:0.0:1790778941.559582:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790778941.559591:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663691264:12345-0@lo:501: 00000100:00100000:0.0:1790778941.559761:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663691264:12345-0@lo:501: Request processed in 171us (2897us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.559769:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790778941.559866:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663691264:0@lo:501: 00000100:00100000:1.0:1790778941.559962:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663691392:0@lo:503: 00000100:00100000:1.0:1790778941.560009:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.560190:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778941.560296:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663691392 00000100:00100000:2.0:1790778941.560301:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663691392 00000100:00100000:2.0:1790778941.560372:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790778941.560381:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663691392:12345-0@lo:503: 00000100:00100000:2.0:1790778941.560521:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663691392:12345-0@lo:503: Request processed in 141us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778941.560537:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790778941.560601:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663691392:0@lo:503: 00000100:00100000:2.0:1790778941.561311:0:10050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10050:1877767663691520:0@lo:502: 00000100:00100000:2.0:1790778941.561354:0:10050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.561386:0:10050:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702bc0540 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.561435:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663691520 00000100:00100000:0.0:1790778941.561440:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663691520 00000100:00100000:0.0:1790778941.561520:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790778941.561528:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:10050:x1877767663691520:12345-0@lo:502: 00000100:00100000:0.0:1790778941.561615:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:10050:x1877767663691520:12345-0@lo:502: Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.561621:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790778941.561711:0:10050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10050:1877767663691520:0@lo:502: 00000020:01000000:2.0:1790778941.561743:0:10050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790778941.561751:0:10050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778941.561753:0:10050:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790778941.561758:0:10050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790778941.561760:0:10050:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790778941.561773:0:10050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10050:1877767663691648:0@lo:502: 00000100:00100000:2.0:1790778941.561802:0:10050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.562507:0:10050:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.562955:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663691648 00000100:00100000:3.0:1790778941.562962:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663691648 00000100:00100000:3.0:1790778941.562995:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790778941.563003:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:10050:x1877767663691648:12345-0@lo:502: 00000100:00100000:3.0:1790778941.563352:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:10050:x1877767663691648:12345-0@lo:502: Request processed in 348us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.563360:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790778941.563493:0:10050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10050:1877767663691648:0@lo:502: 00000020:01000000:2.0:1790778941.564034:0:10050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778941.564041:0:10050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778941.564044:0:10050:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790778941.564049:0:10050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1790778941.568307:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1790778941.568349:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790778941.568361:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.568374:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778941.568383:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790778941.568395:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b7712708000 from 39 10000000:01000000:3.0:1790778941.568399:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790778941.568434:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.568442:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.568452:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778941.568473:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663691776:0@lo:101: 00000100:00100000:3.0:1790778941.568849:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.568967:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1300 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.569002:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663691776 00000100:00100000:0.0:1790778941.569010:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663691776 00000100:00100000:0.0:1790778941.569060:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790778941.569070:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663691776:12345-0@lo:101: 00010000:00010000:0.0:1790778941.569083:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778941.569097:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ca91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.569131:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ca91 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.569142:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca91 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.569150:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768000, rc 0) 00000100:00100000:0.0:1790778941.569198:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663691776:12345-0@lo:101: Request processed in 130us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.569205:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790778941.569283:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663691776:0@lo:101: 00010000:00010000:3.0:1790778941.569297:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.569305:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778941.569363:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663691904:0@lo:501: 00000100:00100000:3.0:1790778941.569389:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.569413:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1300 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.569481:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663691904 00000100:00100000:0.0:1790778941.569486:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663691904 00000100:00100000:0.0:1790778941.569517:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790778941.569524:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663691904:12345-0@lo:501: 00000100:00100000:0.0:1790778941.569628:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663691904:12345-0@lo:501: Request processed in 104us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.569635:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790778941.569709:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663691904:0@lo:501: 00000100:00100000:3.0:1790778941.569737:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692032:0@lo:503: 00000100:00100000:3.0:1790778941.569777:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.569791:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.569811:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663692032 00000100:00100000:3.0:1790778941.569815:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663692032 00000100:00100000:3.0:1790778941.569840:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790778941.570548:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663692032:12345-0@lo:503: 00000100:00100000:3.0:1790778941.570664:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663692032:12345-0@lo:503: Request processed in 817us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.570671:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790778941.570845:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692032:0@lo:503: 00000100:00100000:0.0:1790778941.576148:0:10051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10051:1877767663692160:0@lo:502: 00000100:00100000:0.0:1790778941.576301:0:10051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.576349:0:10051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1790778941.577006:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663692160 00000100:00100000:1.0:1790778941.577016:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663692160 00000100:00100000:1.0:1790778941.577062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790778941.577080:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:10051:x1877767663692160:12345-0@lo:502: 00000100:00100000:1.0:1790778941.577208:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:10051:x1877767663692160:12345-0@lo:502: Request processed in 130us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778941.577236:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790778941.577967:0:10051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10051:1877767663692160:0@lo:502: 00000100:00100000:0.0:1790778941.578026:0:10051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10051:1877767663692288:0@lo:502: 00000100:00100000:0.0:1790778941.578069:0:10051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.578095:0:10051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.578467:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663692288 00000100:00100000:3.0:1790778941.578472:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663692288 00000100:00100000:3.0:1790778941.578519:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790778941.578527:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:10051:x1877767663692288:12345-0@lo:502: 00000100:00100000:3.0:1790778941.578627:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:10051:x1877767663692288:12345-0@lo:502: Request processed in 100us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.578634:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790778941.581599:0:10051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10051:1877767663692288:0@lo:502: 00000040:00080000:0.0:1790778941.581655:0:10051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1790778941.581835:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1790778941.581861:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790778941.581872:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.581934:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778941.581945:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790778941.581947:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7712708000 from 6 10000000:01000000:2.0:1790778941.581956:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790778941.581990:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.581999:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.582008:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778941.582024:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692416:0@lo:101: 00000100:00100000:2.0:1790778941.582077:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.582213:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.582345:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663692416 00000100:00100000:3.0:1790778941.582353:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663692416 00000100:00100000:3.0:1790778941.582408:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790778941.582418:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663692416:12345-0@lo:101: 00010000:00010000:3.0:1790778941.582432:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778941.582447:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936caa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ca9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.582472:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936caa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ca9f expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.582483:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936caa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca9f expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.582492:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894ac00, rc 0) 00000100:00100000:3.0:1790778941.582553:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663692416:12345-0@lo:101: Request processed in 137us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.582561:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790778941.583007:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692416:0@lo:101: 00010000:00010000:2.0:1790778941.583022:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.583029:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778941.583070:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692544:0@lo:256: 00000100:00100000:2.0:1790778941.583100:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.583122:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.583432:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663692544 00000100:00100000:3.0:1790778941.583438:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663692544 00000100:00100000:3.0:1790778941.583479:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790778941.583489:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663692544:12345-0@lo:256: 20000000:01000000:3.0:1790778941.583505:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790778941.583523:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790778941.583526:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1790778941.583622:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663692544:12345-0@lo:256: Request processed in 135us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.583630:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790778941.583676:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692544:0@lo:256: 10000000:01000000:2.0:1790778941.583720:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790778941.583727:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.583735:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778941.583750:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1790778941.583752:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1790778941.583755:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790778941.583772:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.583780:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.583788:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778941.583800:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692672:0@lo:101: 00000100:00100000:2.0:1790778941.583827:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.583850:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.583910:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663692672 00000100:00100000:0.0:1790778941.583916:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663692672 00000100:00100000:0.0:1790778941.583950:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790778941.583958:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663692672:12345-0@lo:101: 00010000:00010000:0.0:1790778941.583965:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778941.583976:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936caad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.583992:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936caad expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.584000:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936caad expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.584006:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769200, rc 0) 00000100:00100000:0.0:1790778941.584039:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663692672:12345-0@lo:101: Request processed in 83us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.584045:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790778941.584118:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692672:0@lo:101: 00010000:00010000:2.0:1790778941.584129:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.584136:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778941.584181:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692800:0@lo:501: 00000100:00100000:2.0:1790778941.584214:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.584248:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.584350:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663692800 00000100:00100000:3.0:1790778941.584355:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663692800 00000100:00100000:3.0:1790778941.584387:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790778941.584393:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663692800:12345-0@lo:501: 00000100:00100000:3.0:1790778941.584512:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663692800:12345-0@lo:501: Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.584520:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790778941.585188:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692800:0@lo:501: 00000100:00100000:2.0:1790778941.585238:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692928:0@lo:503: 00000100:00100000:2.0:1790778941.585286:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.585352:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.587265:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663692928 00000100:00100000:0.0:1790778941.587276:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663692928 00000100:00100000:0.0:1790778941.587339:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790778941.587355:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663692928:12345-0@lo:503: 00000100:00100000:0.0:1790778941.587498:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663692928:12345-0@lo:503: Request processed in 145us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.587505:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790778941.587590:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663692928:0@lo:503: 00000100:00100000:2.0:1790778941.588632:0:10053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10053:1877767663693056:0@lo:502: 00000100:00100000:2.0:1790778941.588688:0:10053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.588739:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663693056 00000100:00100000:3.0:1790778941.588744:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663693056 00000100:00100000:3.0:1790778941.588776:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790778941.588785:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:10053:x1877767663693056:12345-0@lo:502: 00000100:00100000:3.0:1790778941.588900:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:10053:x1877767663693056:12345-0@lo:502: Request processed in 115us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.588909:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790778941.589100:0:10053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778941.589117:0:10053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10053:1877767663693056:0@lo:502: 00000020:01000000:2.0:1790778941.589140:0:10053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790778941.589148:0:10053:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790778941.589154:0:10053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778941.589157:0:10053:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790778941.589162:0:10053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790778941.589166:0:10053:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:2.0:1790778941.589185:0:10053:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790778941.589188:0:10053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790778941.589202:0:10053:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9b773409cd40) 00000020:00000080:2.0:1790778941.589242:0:10053:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1790778941.589478:0:10053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790778941.589564:0:10053:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1790778941.589570:0:10053:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790778941.589578:0:10053:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936cac2 00010000:00080000:2.0:1790778941.589618:0:10053:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7603886000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1790778941.589836:0:10053:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1790778941.589987:0:10053:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790778941.590003:0:10053:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790778941.590149:0:10053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790778941.590476:0:10053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790778941.590606:0:10053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790778941.590696:0:10053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1790778941.591409:0:10054:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790778941.591414:0:10054:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790778941.594167:0:10053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790778941.594195:0:10053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790778941.594252:0:10053:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790778941.594276:0:10053:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936cac9 00000100:00080000:0.0:1790778941.594287:0:10053:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790778941.594306:0:10053:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b7603886000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790778941.594343:0:10053:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603841f80 x1877767663693184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790778941.594410:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663693184:0@lo:8: 00000100:00100000:1.0:1790778941.594478:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.594574:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663693184 00000100:00100000:2.0:1790778941.594581:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663693184 00000100:00080000:0.0:1790778941.594584:0:10053:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1790778941.594624:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790778941.594640:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1877767663693184:12345-0@lo:8: 00010000:00080000:2.0:1790778941.594668:0:8440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:2.0:1790778941.594709:0:8440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936cad0 00002000:00100000:2.0:1790778941.594719:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9b7603882800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1790778941.594722:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1790778941.594725:0:8440:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790778941.594773:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1790778941.594912:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663693312:0@lo:400: 00000100:00100000:0.0:1790778941.594966:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1790778941.595001:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1790778941.595025:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9b7603887800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790778941.595083:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1877767663693184:12345-0@lo:8: Request processed in 450us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778941.595090:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1790778941.595104:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603841f80 x1877767663693184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790778951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778941.595114:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790778941.595122:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1790778941.595130:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790778941.595133:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790778941.595136:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7603886000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790778941.595160:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790778941.595166:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663693184:0@lo:8: 00000004:00080000:2.0:1790778941.595197:0:10054:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790778941.595253:0:10054:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 259602372774ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790778941.595259:0:10054:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1790778941.595301:0:10055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10055:1877767663694592:0@lo:700: 00000100:00100000:2.0:1790778941.595329:0:10055:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.595350:0:8447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663694592 00000100:00100000:2.0:1790778941.595354:0:8447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663694592 00000100:00100000:0.0:1790778941.595359:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1877767663693824:0@lo:400: 00000100:00100000:0.0:1790778941.595408:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.595414:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790778941.595424:0:8447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10055:x1877767663694592:12345-0@lo:700: 00000100:00100000:0.0:1790778941.595436:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663694336:0@lo:400: 00000100:00100000:2.0:1790778941.595457:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603022680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1877767663694720:0@lo:700: 00000100:00100000:0.0:1790778941.595462:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.595483:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790778941.595491:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663693696:0@lo:400: 00000100:00100000:2.0:1790778941.595504:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.595522:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.595528:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328e40 going to sleep for 11 seconds 00000100:00080000:2.0:1790778941.595543:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790778941.595548:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663694208:0@lo:400: 00000100:00100000:2.0:1790778941.595552:0:10055:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.595574:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.595620:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663693440:0@lo:400: 00000100:00100000:0.0:1790778941.595651:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.595653:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663694208 00000100:00100000:2.0:1790778941.595658:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663694208 00000100:00100000:0.0:1790778941.595674:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663693952:0@lo:400: 00000100:00100000:2.0:1790778941.595689:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790778941.595697:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663694208:12345-0@lo:400: 00000100:00100000:1.0:1790778941.595699:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663694720 00000100:00100000:1.0:1790778941.595703:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663694720 00000100:00100000:0.0:1790778941.595724:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778941.595738:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790778941.595745:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663694208:12345-0@lo:400: Request processed in 49us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.595748:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663694464:0@lo:400: 00000100:00100000:1.0:1790778941.595749:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1877767663694720:12345-0@lo:700: 00000100:00100000:2.0:1790778941.595755:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778941.595784:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.595810:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790778941.595818:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663693568:0@lo:400: 00000100:00080000:1.0:1790778941.595834:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778941.595845:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.595858:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663694080:0@lo:400: 00000100:00100000:0.0:1790778941.595876:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.595947:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663693312 00000100:00100000:0.0:1790778941.595951:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663693312 00000100:00100000:0.0:1790778941.595973:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663693824 00000100:00100000:0.0:1790778941.595977:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663693824 00000100:00100000:0.0:1790778941.596008:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663694336 00000100:00100000:2.0:1790778941.596009:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663694080 00000100:00100000:2.0:1790778941.596016:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663694080 00000100:00100000:0.0:1790778941.596018:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663694336 00000100:00100000:0.0:1790778941.596041:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663693952 00000100:00100000:0.0:1790778941.596045:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663693952 00000100:00100000:2.0:1790778941.596047:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790778941.596064:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663694464 00000100:00100000:0.0:1790778941.596068:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663694464 00000100:00100000:2.0:1790778941.596069:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663694080:12345-0@lo:400: 00000100:00100000:0.0:1790778941.596085:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663693568 00000100:00100000:0.0:1790778941.596090:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663693568 00000100:00100000:0.0:1790778941.596108:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790778941.596117:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663694080:12345-0@lo:400: Request processed in 60us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.596118:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663693312:12345-0@lo:400: 00000100:00100000:2.0:1790778941.596131:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790778941.596166:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663693312:12345-0@lo:400: Request processed in 50us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.596173:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790778941.596186:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790778941.596193:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1877767663693824:12345-0@lo:400: 00000100:00100000:0.0:1790778941.596224:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1877767663693824:12345-0@lo:400: Request processed in 31us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.596239:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790778941.596254:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790778941.596260:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3652:x1877767663694336:12345-0@lo:400: 00000100:00100000:0.0:1790778941.596297:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3652:x1877767663694336:12345-0@lo:400: Request processed in 37us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.596303:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790778941.596315:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790778941.596321:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663693952:12345-0@lo:400: 00000100:00100000:0.0:1790778941.596347:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663693952:12345-0@lo:400: Request processed in 27us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.596352:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790778941.596363:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790778941.596368:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663694464:12345-0@lo:400: 00000100:00100000:0.0:1790778941.596409:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663694464:12345-0@lo:400: Request processed in 40us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.596415:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790778941.596426:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790778941.596432:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663693568:12345-0@lo:400: 00000100:00100000:0.0:1790778941.596457:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663693568:12345-0@lo:400: Request processed in 26us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.596463:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790778941.596490:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663693696 00000100:00100000:0.0:1790778941.596494:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663693696 00000100:00100000:0.0:1790778941.596510:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663693440 00000100:00100000:0.0:1790778941.596512:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663693440 00000100:00100000:0.0:1790778941.596523:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790778941.596529:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663693696:12345-0@lo:400: 00000100:00100000:0.0:1790778941.596559:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663693696:12345-0@lo:400: Request processed in 31us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.596574:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790778941.596595:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790778941.596603:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663693440:12345-0@lo:400: 00000100:00100000:0.0:1790778941.596635:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663693440:12345-0@lo:400: Request processed in 34us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.596641:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1790778941.596655:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790778941.596660:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790778941.596681:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603843b80 x1877767663693568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778941.596692:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663693568:0@lo:400: 00010000:00080000:0.0:1790778941.596701:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603842a00 x1877767663694080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778941.596708:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663694080:0@lo:400: 00000100:00100000:0.0:1790778941.596715:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663693440:0@lo:400: 00010000:00080000:0.0:1790778941.596723:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603840a80 x1877767663693952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778941.596729:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663693952:0@lo:400: 00010000:00080000:0.0:1790778941.596737:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603842d80 x1877767663694464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778941.596745:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663694464:0@lo:400: 00000100:00100000:0.0:1790778941.596788:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663693696:0@lo:400: 00010000:00080000:0.0:1790778941.596799:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603841180 x1877767663694208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778941.596819:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663694208:0@lo:400: 00010000:00080000:0.0:1790778941.596834:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603843800 x1877767663693312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778941.596841:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663693312:0@lo:400: 00010000:00080000:0.0:1790778941.596850:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603843100 x1877767663693824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778941.596856:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1877767663693824:0@lo:400: 00010000:00080000:0.0:1790778941.596863:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603841880 x1877767663694336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778941.596870:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663694336:0@lo:400: 00000020:01000000:0.0:1790778941.596956:0:10053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778941.596962:0:10053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778941.596965:0:10053:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790778941.596968:0:10053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778941.596971:0:10053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778941.596973:0:10053:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790778941.596975:0:10053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790778941.596977:0:10053:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790778941.596999:0:10053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10053:1877767663694848:0@lo:502: 00000100:00100000:0.0:1790778941.597043:0:10053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.597073:0:10053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778941.597104:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663694848 00000100:00100000:1.0:1790778941.597109:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663694848 00000100:00100000:1.0:1790778941.597141:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790778941.597157:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:10053:x1877767663694848:12345-0@lo:502: 00000100:00100000:1.0:1790778941.597274:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:10053:x1877767663694848:12345-0@lo:502: Request processed in 126us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778941.597287:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790778941.597801:0:10053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10053:1877767663694848:0@lo:502: 00000004:00080000:2.0:1790778941.597804:0:7455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000020:01000000:0.0:1790778941.597825:0:10053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778941.597830:0:10053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778941.597833:0:10053:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790778941.597842:0:10053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1790778941.598080:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1790778941.598110:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1790778941.598120:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.598130:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778941.598140:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790778941.598143:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b77208a9000 from 39 10000000:01000000:3.0:1790778941.598145:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790778941.598169:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.598177:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.598185:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778941.598198:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663694976:0@lo:101: 00000100:00100000:3.0:1790778941.598241:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.598274:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1240 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.598299:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663694976 00000100:00100000:0.0:1790778941.598304:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663694976 00000100:00100000:0.0:1790778941.598337:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790778941.598347:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663694976:12345-0@lo:101: 00010000:00010000:0.0:1790778941.598357:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778941.598368:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936cade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cad7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.598460:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936cade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cad7 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.598472:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936cade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cad7 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.598481:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769a00, rc 0) 00000100:00100000:0.0:1790778941.598525:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663694976:12345-0@lo:101: Request processed in 180us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.598531:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790778941.598655:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663694976:0@lo:101: 00010000:00010000:3.0:1790778941.598670:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.598679:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778941.598856:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663695104:0@lo:501: 00000100:00100000:3.0:1790778941.598925:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.598949:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1240 going to sleep for 11 seconds 00000100:00100000:1.0:1790778941.599382:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663695104 00000100:00100000:1.0:1790778941.599388:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663695104 00000100:00100000:1.0:1790778941.599428:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790778941.599436:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663695104:12345-0@lo:501: 00000100:00100000:1.0:1790778941.599568:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663695104:12345-0@lo:501: Request processed in 132us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778941.599575:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790778941.599605:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663695104:0@lo:501: 00000100:00100000:2.0:1790778941.599635:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663695232:0@lo:503: 00000100:00100000:2.0:1790778941.599674:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.599704:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720bd6000 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.599797:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663695232 00000100:00100000:3.0:1790778941.599802:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663695232 00000100:00100000:3.0:1790778941.599833:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790778941.599840:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663695232:12345-0@lo:503: 00000100:00100000:3.0:1790778941.599948:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663695232:12345-0@lo:503: Request processed in 108us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.599955:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1790778941.599983:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663695232:0@lo:503: 00000100:00100000:2.0:1790778941.600308:0:10056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10056:1877767663695360:0@lo:502: 00000100:00100000:2.0:1790778941.600341:0:10056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.600375:0:10056:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720bd6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778941.600430:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663695360 00000100:00100000:1.0:1790778941.600435:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663695360 00000100:00100000:1.0:1790778941.600501:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790778941.600509:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:10056:x1877767663695360:12345-0@lo:502: 00000100:00100000:1.0:1790778941.600594:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:10056:x1877767663695360:12345-0@lo:502: Request processed in 86us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778941.600600:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790778941.602463:0:10056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10056:1877767663695360:0@lo:502: 00000100:00100000:2.0:1790778941.602535:0:10056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10056:1877767663695488:0@lo:502: 00000100:00100000:2.0:1790778941.602592:0:10056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.603405:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663695488 00000100:00100000:3.0:1790778941.603415:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663695488 00000100:00100000:2.0:1790778941.603440:0:10056:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328240 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.604053:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790778941.604064:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:10056:x1877767663695488:12345-0@lo:502: 00000100:00100000:3.0:1790778941.604188:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:10056:x1877767663695488:12345-0@lo:502: Request processed in 126us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.604197:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790778941.604510:0:10056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10056:1877767663695488:0@lo:502: 00000040:00080000:2.0:1790778941.604540:0:10056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1790778941.604711:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1790778941.604733:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790778941.604744:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.604755:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778941.604765:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790778941.604768:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b77208a9000 from 6 10000000:01000000:3.0:1790778941.604771:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790778941.604800:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.604816:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.604824:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778941.604842:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663695616:0@lo:101: 00000100:00100000:3.0:1790778941.604915:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.604948:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1240 going to sleep for 11 seconds 00000100:00100000:2.0:1790778941.605028:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663695616 00000100:00100000:2.0:1790778941.605034:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663695616 00000100:00100000:2.0:1790778941.605081:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790778941.605090:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663695616:12345-0@lo:101: 00010000:00010000:2.0:1790778941.605101:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778941.605114:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e6e00/0xb1aa4014e936caec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cae5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.605136:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6e00/0xb1aa4014e936caec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cae5 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.605320:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e6e00/0xb1aa4014e936caec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cae5 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778941.605332:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6e00, rc 0) 00000100:00100000:2.0:1790778941.605380:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663695616:12345-0@lo:101: Request processed in 291us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.605480:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663695616:0@lo:101: 00010000:00010000:3.0:1790778941.605494:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.605504:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778941.605557:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663695744:0@lo:256: 40000000:02000000:1.0:1790778941.605590:0:6530:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1790778941.605598:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.605618:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1240 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.605632:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663695744 00000100:00100000:3.0:1790778941.605635:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663695744 00000100:00100000:3.0:1790778941.605659:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790778941.605666:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663695744:12345-0@lo:256: 20000000:01000000:3.0:1790778941.605680:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790778941.605698:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790778941.605702:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1790778941.605782:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663695744:12345-0@lo:256: Request processed in 116us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.605794:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790778941.605827:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663695744:0@lo:256: 10000000:01000000:3.0:1790778941.605868:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790778941.605874:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.605916:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778941.605924:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790778941.605926:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1790778941.605928:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790778941.605944:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.605952:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.605959:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778941.605971:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663695872:0@lo:101: 00000100:00100000:3.0:1790778941.605995:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.606014:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1240 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.606034:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663695872 00000100:00100000:3.0:1790778941.606037:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663695872 00000100:00100000:3.0:1790778941.606065:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790778941.606072:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663695872:12345-0@lo:101: 00010000:00010000:3.0:1790778941.606087:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778941.606096:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7742148800/0xb1aa4014e936cafa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936caf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.606110:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7742148800/0xb1aa4014e936cafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936caf3 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.606118:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7742148800/0xb1aa4014e936cafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936caf3 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.606125:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742148800, rc 0) 00000100:00100000:3.0:1790778941.606289:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663695872:12345-0@lo:101: Request processed in 217us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.606295:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790778941.606325:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663695872:0@lo:101: 00010000:00010000:3.0:1790778941.606336:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778941.606343:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778941.606449:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663696000:0@lo:501: 00000100:00100000:3.0:1790778941.606472:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.606484:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1240 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.606494:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663696000 00000100:00100000:3.0:1790778941.606497:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663696000 00000100:00100000:3.0:1790778941.606516:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1790778941.606523:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663696000:12345-0@lo:501: 00000100:00100000:3.0:1790778941.606640:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663696000:12345-0@lo:501: Request processed in 117us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.606646:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1790778941.606673:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663696000:0@lo:501: 00000100:00100000:3.0:1790778941.606697:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663696128:0@lo:503: 00000100:00100000:3.0:1790778941.606735:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.606749:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1240 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.606759:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663696128 00000100:00100000:3.0:1790778941.606762:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663696128 00000100:00100000:3.0:1790778941.606779:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790778941.606784:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663696128:12345-0@lo:503: 00000100:00100000:3.0:1790778941.606849:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663696128:12345-0@lo:503: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.606855:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790778941.606904:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663696128:0@lo:503: 00000100:00100000:3.0:1790778941.607036:0:10058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10058:1877767663696256:0@lo:502: 00000100:00100000:2.0:1790778941.607303:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790778941.607530:0:10058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.607599:0:10058:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1240 going to sleep for 11 seconds 00000100:00100000:2.0:1790778941.610248:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663696256 00000100:00100000:2.0:1790778941.610262:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663696256 00000100:00100000:2.0:1790778941.610316:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790778941.610335:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:10058:x1877767663696256:12345-0@lo:502: 00000100:00100000:2.0:1790778941.610773:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:10058:x1877767663696256:12345-0@lo:502: Request processed in 439us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778941.610780:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790778941.610863:0:10058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10058:1877767663696256:0@lo:502: 00000100:00100000:1.0:1790778941.612439:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1877767663694720:12345-0@lo:700: Request processed in 16689us (16931us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778941.612451:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790778941.612611:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603022680 x1877767663694720/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790778957 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778941.612624:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603022680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1877767663694720:0@lo:700: 40000000:02000000:1.0:1790778941.612635:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000020:01000000:3.0:1790778941.613356:0:10058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790778941.613365:0:10058:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1790778941.613373:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778941.613376:0:10058:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790778941.613382:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790778941.613523:0:10058:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:3.0:1790778941.613605:0:10058:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790778941.613615:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790778941.613631:0:10058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b773b783380) 00000020:00000080:3.0:1790778941.613654:0:10058:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1790778941.613661:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790778941.613753:0:10058:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790778941.613761:0:10058:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:3.0:1790778941.613768:0:10058:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936cb08 00010000:00080000:3.0:1790778941.613800:0:10058:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b76035f4000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1790778941.614043:0:10058:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1790778941.614304:0:10058:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790778941.614319:0:10058:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790778941.614632:0:10058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778941.614743:0:10058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778941.614863:0:10058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1790778941.616395:0:10058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1790778941.617740:0:10059:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790778941.617746:0:10059:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:1.0:1790778941.625571:0:9517:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1790778941.625912:0:8447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10055:x1877767663694592:12345-0@lo:700: Request processed in 30485us (30576us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778941.625926:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790778941.625981:0:10055:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b769c00 x1877767663694592/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790778957 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778941.625996:0:10055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10055:1877767663694592:0@lo:700: 00000020:00000080:0.0:1790778941.627222:0:10058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790778941.627247:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790778941.627290:0:10058:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790778941.627318:0:10058:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936cb0f 00000100:00080000:0.0:1790778941.627327:0:10058:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790778941.627338:0:10058:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b76035f4000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790778941.627370:0:10058:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603747800 x1877767663696384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790778941.627448:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663696384:0@lo:8: 00000100:00100000:1.0:1790778941.627513:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.627591:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663696384 00000100:00100000:2.0:1790778941.627606:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663696384 00000100:00100000:2.0:1790778941.627637:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790778941.627643:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1877767663696384:12345-0@lo:8: 00010000:00080000:2.0:1790778941.627668:0:8855:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:2.0:1790778941.627691:0:8855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936cb16 00002000:00100000:2.0:1790778941.627713:0:8855:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b7603884000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790778941.627718:0:8855:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790778941.627721:0:8855:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790778941.627789:0:8855:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790778941.627810:0:8855:0:(import.c:65:import_set_state_nolock()) ffff9b7603880800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1790778941.627936:0:10058:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790778941.628014:0:10058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778941.628024:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778941.628026:0:10058:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790778941.628029:0:10058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778941.628032:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778941.628034:0:10058:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790778941.628037:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790778941.628039:0:10058:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790778941.628061:0:10058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10058:1877767663696512:0@lo:502: 00000100:00100000:0.0:1790778941.628113:0:10058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.628137:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663696512 00000100:00100000:0.0:1790778941.628140:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663696512 00000100:00100000:0.0:1790778941.628181:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790778941.628188:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:10058:x1877767663696512:12345-0@lo:502: 00000100:00100000:0.0:1790778941.628296:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:10058:x1877767663696512:12345-0@lo:502: Request processed in 108us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.628304:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790778941.628351:0:10058:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77182a8480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.628370:0:10058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10058:1877767663696512:0@lo:502: 00000020:01000000:0.0:1790778941.628394:0:10058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778941.628398:0:10058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778941.628400:0:10058:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790778941.628582:0:10058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1790778941.628630:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1790778941.628659:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790778941.628669:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.628680:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778941.628950:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790778941.628953:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b773059cd40 from 1 10000000:01000000:0.0:1790778941.628956:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790778941.628978:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.628987:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.628996:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778941.629008:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663696640:0@lo:101: 00000100:00100000:0.0:1790778941.629039:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.629061:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707ea0480 going to sleep for 11 seconds 00000100:00100000:2.0:1790778941.629606:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1877767663696384:12345-0@lo:8: Request processed in 1959us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778941.629615:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1790778941.629688:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603747800 x1877767663696384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790778951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778941.629865:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790778941.629874:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790778941.629980:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790778941.629985:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790778941.629988:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b76035f4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790778941.630005:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790778941.630011:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663696384:0@lo:8: 00000100:00100000:1.0:1790778941.630036:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663696640 00000100:00100000:1.0:1790778941.630041:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663696640 00000100:00100000:1.0:1790778941.630082:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790778941.630090:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663696640:12345-0@lo:101: 00010000:00010000:1.0:1790778941.630101:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778941.630117:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cb24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778941.630139:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cb1d expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778941.630380:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cb1d expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778941.630391:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cea00, rc 0) 00000100:00100000:1.0:1790778941.630584:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663696640:12345-0@lo:101: Request processed in 494us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778941.630591:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000004:00080000:1.0:1790778941.630900:0:10059:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1790778941.631756:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663696640:0@lo:101: 00010000:00010000:0.0:1790778941.631835:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.631847:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778941.631939:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663696768:0@lo:501: 00000100:00100000:0.0:1790778941.631981:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778941.632010:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707ea0480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.632029:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663696768 00000100:00100000:0.0:1790778941.632034:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663696768 00000100:00100000:0.0:1790778941.632065:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790778941.632081:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663696768:12345-0@lo:501: 00000100:00100000:0.0:1790778941.632224:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663696768:12345-0@lo:501: Request processed in 143us (242us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790778941.632241:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790778941.632277:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663696768:0@lo:501: 10000000:01000000:0.0:1790778941.632303:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790778941.632310:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778941.632318:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790778941.632432:0:10059:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 259639550759ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790778941.632440:0:10059:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1790778941.638418:0:10060:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790778941.638452:0:10060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10060:1877767663697024:0@lo:7: 00000100:00100000:3.0:1790778941.639071:0:10060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.639105:0:10060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790778941.639159:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663697024 00000100:00100000:1.0:1790778941.639167:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663697024 00000100:00100000:1.0:1790778941.639228:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790778941.639248:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10060:x1877767663697024:12345-0@lo:7: 00000100:00100000:0.0:1790778941.639399:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663696896:0@lo:13: 00000100:00100000:0.0:1790778941.639443:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790778941.640797:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790778941.641614:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663696896 00000100:00100000:0.0:1790778941.641625:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663696896 00000100:00100000:0.0:1790778941.641668:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790778941.641677:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877767663696896:12345-0@lo:13: 00002000:00000024:0.0:1790778941.642656:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923914752 avail 3692392448 00000100:00100000:0.0:1790778941.642755:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877767663696896:12345-0@lo:13: Request processed in 1077us (3309us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.642763:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1790778941.642801:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7704143100 x1877767663696896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778941.642823:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663696896:0@lo:13: 00000004:00080000:3.0:1790778941.645373:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1790778941.646186:0:10055:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1790778941.646214:0:10055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603023480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10055:1877767663697280:0@lo:7: 00000100:00100000:3.0:1790778941.646294:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663697152:0@lo:13: 00000100:00100000:2.0:1790778941.646302:0:10055:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.646336:0:10055:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.646349:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.646363:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663697280 00000100:00100000:2.0:1790778941.646370:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663697280 00000100:00100000:2.0:1790778941.646419:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790778941.646431:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10055:x1877767663697280:12345-0@lo:7: 00000100:00100000:0.0:1790778941.647950:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663697152 00000100:00100000:0.0:1790778941.647960:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663697152 00000100:00100000:0.0:1790778941.648005:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790778941.648012:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1877767663697152:12345-0@lo:13: 00002000:00000024:0.0:1790778941.648041:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923914752 avail 3692392448 00000100:00100000:0.0:1790778941.648126:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1877767663697152:12345-0@lo:13: Request processed in 113us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.648133:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790778941.648258:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603020700 x1877767663697152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778941.648288:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663697152:0@lo:13: 00002000:00080000:1.0:1790778941.651943:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1790778941.651952:0:8440:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790778941.652044:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10060:x1877767663697024:12345-0@lo:7: Request processed in 12793us (13522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778941.652055:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1790778941.652084:0:10060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7f6680 x1877767663697024/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790778957 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778941.652100:0:10060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10060:1877767663697024:0@lo:7: 00000004:00080000:3.0:1790778941.652114:0:10060:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790778941.652153:0:10060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10060:1877767663697408:0@lo:5: 00000100:00100000:3.0:1790778941.652203:0:10060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.652238:0:10060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790778941.652351:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663697408 00000100:00100000:1.0:1790778941.652358:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663697408 00000100:00100000:1.0:1790778941.652400:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790778941.652408:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10060:x1877767663697408:12345-0@lo:5: 00002000:00080000:1.0:1790778941.652432:0:8438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1790778941.652435:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:1.0:1790778941.664810:0:8855:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1790778941.664818:0:8855:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790778941.665181:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10055:x1877767663697280:12345-0@lo:7: Request processed in 18749us (18880us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778941.665192:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1790778941.666169:0:10055:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603023480 x1877767663697280/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790778957 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778941.666186:0:10055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603023480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10055:1877767663697280:0@lo:7: 00000004:00080000:2.0:1790778941.666201:0:10055:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1790778941.666249:0:10055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603023480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10055:1877767663697536:0@lo:5: 00000100:00100000:2.0:1790778941.666311:0:10055:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.666582:0:10055:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.666621:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663697536 00000100:00100000:0.0:1790778941.666629:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663697536 00000100:00100000:0.0:1790778941.666691:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790778941.666700:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10055:x1877767663697536:12345-0@lo:5: 00002000:00080000:0.0:1790778941.666730:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1790778941.666779:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10055:x1877767663697536:12345-0@lo:5: Request processed in 81us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.666784:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1790778941.666825:0:10055:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603023480 x1877767663697536/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778957 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778941.666837:0:10055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603023480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10055:1877767663697536:0@lo:5: 00000004:00080000:3.0:1790778941.666847:0:10055:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1790778941.666872:0:10055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10055:1877767663697664:0@lo:5: 00000100:00100000:3.0:1790778941.666917:0:10055:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778941.666939:0:10055:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790778941.667927:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663697664 00000100:00100000:2.0:1790778941.668441:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663697664 00000100:00100000:2.0:1790778941.668544:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790778941.668553:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10055:x1877767663697664:12345-0@lo:5: 00002000:00080000:2.0:1790778941.668587:0:8855:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000001:00080000:2.0:1790778941.670238:0:9517:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1790778941.670250:0:9517:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790778941.672313:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:10055:x1877767663697664:12345-0@lo:5: Request processed in 3755us (5389us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790778941.672327:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1790778941.672542:0:10055:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041ac380 x1877767663697664/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778957 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778941.672561:0:10055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10055:1877767663697664:0@lo:5: 00000004:00080000:2.0:1790778941.672577:0:10055:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1790778941.672619:0:10055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603023800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10055:1877767663697792:0@lo:900: 00000100:00100000:2.0:1790778941.672658:0:10055:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.672700:0:10055:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778941.672756:0:6534:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663697792 00000100:00100000:3.0:1790778941.672764:0:6534:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663697792 00000100:00100000:3.0:1790778941.672814:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790778941.672823:0:6534:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10055:x1877767663697792:12345-0@lo:900: 00000100:00100000:3.0:1790778941.672910:0:6534:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10055:x1877767663697792:12345-0@lo:900: Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.672914:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10060:x1877767663697408:12345-0@lo:5: Request processed in 20504us (20708us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790778941.672928:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790778941.672933:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790778941.672987:0:10060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7f6680 x1877767663697408/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778957 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1790778941.672993:0:10055:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603023800 x1877767663697792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790778957 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778941.672998:0:10060:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790778941.673006:0:10060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10060:1877767663697408:0@lo:5: 00000004:00080000:3.0:1790778941.673017:0:10060:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790778941.673050:0:10060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10060:1877767663697920:0@lo:700: 00000100:00100000:3.0:1790778941.673080:0:10060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.673126:0:10055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603023800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10055:1877767663697792:0@lo:900: 00000100:00100000:1.0:1790778941.673126:0:8446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663697920 00000100:00100000:3.0:1790778941.673128:0:10060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790778941.673134:0:8446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663697920 00000100:00100000:1.0:1790778941.673183:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790778941.673191:0:8446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10060:x1877767663697920:12345-0@lo:700: 00000001:00080000:3.0:1790778941.687207:0:9517:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1790778941.687443:0:8446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10060:x1877767663697920:12345-0@lo:700: Request processed in 14250us (14359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778941.687466:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790778941.687671:0:10060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041af480 x1877767663697920/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790778957 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778941.687694:0:10060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041af480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10060:1877767663697920:0@lo:700: 00000004:02000040:0.0:1790778941.689425:0:10060:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1790778941.694787:0:10060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603023800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10060:1877767663698048:0@lo:5: 00000100:00100000:2.0:1790778941.694858:0:10060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778941.694945:0:10060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778941.694986:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663698048 00000100:00100000:0.0:1790778941.694994:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663698048 00000100:00100000:0.0:1790778941.695054:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790778941.695064:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10060:x1877767663698048:12345-0@lo:5: 00002000:00080000:3.0:1790778941.707562:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1790778941.707586:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1790778941.710563:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10060:x1877767663698048:12345-0@lo:5: Request processed in 15492us (15696us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790778941.710576:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1790778941.710648:0:10060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603023800 x1877767663698048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778957 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778941.710664:0:10060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603023800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10060:1877767663698048:0@lo:5: 00000004:00080000:0.0:1790778941.710679:0:10060:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:0.0:1790778941.965802:0:10088:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790778941.965812:0:10088:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1790778942.056009:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790778942.056033:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663698176:0@lo:41: 00000100:00100000:1.0:1790778942.056096:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778942.056155:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663698176 00000100:00100000:1.0:1790778942.056162:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663698176 00000100:00100000:1.0:1790778942.056207:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790778942.056237:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663698176:12345-0@lo:41: 00000004:00000024:1.0:1790778942.056277:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790778942.056321:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663698176:12345-0@lo:41: Request processed in 107us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778942.056328:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790778942.056372:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663698176:0@lo:41: 00010000:00010000:3.0:1790778942.378945:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778943.400514:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778943.410006:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778943.410787:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642677632 00000100:00100000:1.0:1790778943.410799:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642677632 00000100:00100000:1.0:1790778943.410846:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:1.0:1790778943.410854:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1877767642677632:12345-192.168.203.3@tcp:250: 00010000:00080000:1.0:1790778943.410921:0:6517:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c0f5e17b-8b38-4652-af67-f49e83fcd571@192.168.203.3@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:1.0:1790778943.410952:0:6517:0:(genops.c:1384:class_connect()) connect: client c0f5e17b-8b38-4652-af67-f49e83fcd571, cookie 0xb1aa4014e936cb2b 00000100:00080000:1.0:1790778943.411084:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9b7601dee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790778943.411167:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+5:2397:x1877767642677632:12345-192.168.203.3@tcp:250: Request processed in 312us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778943.411176:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:3.0:1790778943.413775:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778943.413873:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642677504 00000100:00100000:0.0:1790778943.413926:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642677504 00000100:00100000:0.0:1790778943.413994:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:0.0:1790778943.414009:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+5:6156:x1877767642677504:12345-192.168.203.3@tcp:101: 00010000:00010000:0.0:1790778943.414024:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778943.414043:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cb32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425637 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778943.414072:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425637 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778943.414084:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425637 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778943.414093:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769000, rc 0) 00000100:00100000:0.0:1790778943.414171:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+6:6156:x1877767642677504:12345-192.168.203.3@tcp:101: Request processed in 164us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778943.414178:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:2.0:1790778943.422019:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778943.423378:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642677760 00000100:00100000:0.0:1790778943.423391:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642677760 00000100:00100000:0.0:1790778943.423460:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:0.0:1790778943.423469:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+6:6156:x1877767642677760:12345-192.168.203.3@tcp:501: 00000100:00100000:0.0:1790778943.423587:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+6:6156:x1877767642677760:12345-192.168.203.3@tcp:501: Request processed in 118us (1577us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790778943.423594:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:2.0:1790778943.429068:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778943.432443:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642677888 00000100:00100000:1.0:1790778943.432457:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642677888 00000100:00100000:1.0:1790778943.432581:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:1.0:1790778943.432602:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+6:6156:x1877767642677888:12345-192.168.203.3@tcp:101: 00010000:00010000:1.0:1790778943.432618:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778943.432634:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77055cf400/0xb1aa4014e936cb39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b42563e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778943.432660:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cf400/0xb1aa4014e936cb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42563e expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778943.432670:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77055cf400/0xb1aa4014e936cb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42563e expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778943.432679:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cf400, rc 0) 00000100:00100000:1.0:1790778943.432741:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+7:6156:x1877767642677888:12345-192.168.203.3@tcp:101: Request processed in 141us (3683us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778943.432747:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:3.0:1790778943.435167:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778943.435368:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642678016 00000100:00100000:2.0:1790778943.435394:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642678016 00000100:00100000:2.0:1790778943.435459:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:2.0:1790778943.435469:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+7:6156:x1877767642678016:12345-192.168.203.3@tcp:501: 00000100:00100000:2.0:1790778943.435636:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:6156:x1877767642678016:12345-192.168.203.3@tcp:501: Request processed in 168us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778943.435644:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:2.0:1790778943.439157:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778943.439392:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642678144 00000100:00100000:0.0:1790778943.439406:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642678144 00000100:00100000:0.0:1790778943.439512:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 185 00000100:00100000:0.0:1790778943.439525:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:6156:x1877767642678144:12345-192.168.203.3@tcp:503: 00000100:00100000:0.0:1790778943.439748:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:6156:x1877767642678144:12345-192.168.203.3@tcp:503: Request processed in 225us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778943.439757:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 185 00000100:00100000:3.0:1790778943.446563:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778943.446680:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642678272 00000100:00100000:1.0:1790778943.446695:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642678272 00000100:00100000:1.0:1790778943.446811:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:1.0:1790778943.446822:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:6175:x1877767642678272:12345-192.168.203.3@tcp:502: 00000100:00100000:1.0:1790778943.447004:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:6175:x1877767642678272:12345-192.168.203.3@tcp:502: Request processed in 184us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778943.447012:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:3.0:1790778943.477596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778943.477836:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642678400 00000100:00100000:0.0:1790778943.477851:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642678400 00000100:00100000:0.0:1790778943.478003:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:0.0:1790778943.478015:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:6175:x1877767642678400:12345-192.168.203.3@tcp:502: 00000100:00100000:0.0:1790778943.478689:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:6175:x1877767642678400:12345-192.168.203.3@tcp:502: Request processed in 674us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778943.478699:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:0.0:1790778943.487446:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778943.488585:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642678528 00000100:00100000:1.0:1790778943.488600:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642678528 00000100:00100000:1.0:1790778943.488675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:1.0:1790778943.488686:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:6156:x1877767642678528:12345-192.168.203.3@tcp:101: 00010000:00010000:1.0:1790778943.488703:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778943.488732:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77055cf600/0xb1aa4014e936cb40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b42566f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778943.488762:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cf600/0xb1aa4014e936cb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42566f expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778943.488775:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77055cf600/0xb1aa4014e936cb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42566f expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778943.488784:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cf600, rc 0) 00000100:00100000:1.0:1790778943.488855:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6156:x1877767642678528:12345-192.168.203.3@tcp:101: Request processed in 171us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778943.488862:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:3.0:1790778943.494978:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778943.495468:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642678656 00000100:00100000:2.0:1790778943.495483:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642678656 00000100:00100000:2.0:1790778943.495627:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:2.0:1790778943.495641:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7703020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6156:x1877767642678656:12345-192.168.203.3@tcp:256: 20000000:01000000:2.0:1790778943.495678:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790778943.495711:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790778943.495715:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790778943.495719:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790778943.495722:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790778943.495724:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1790778943.497430:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7703020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6156:x1877767642678656:12345-192.168.203.3@tcp:256: Request processed in 1780us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778943.497445:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:0.0:1790778943.501445:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778943.501569:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642678784 00000100:00100000:2.0:1790778943.501582:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642678784 00000100:00100000:2.0:1790778943.501653:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:2.0:1790778943.501664:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6156:x1877767642678784:12345-192.168.203.3@tcp:101: 00010000:00010000:2.0:1790778943.501686:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778943.501710:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936cb47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425676 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778943.501747:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936cb47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425676 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778943.501759:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936cb47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425676 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778943.501770:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e7600, rc 0) 00000100:00100000:2.0:1790778943.501844:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6156:x1877767642678784:12345-192.168.203.3@tcp:101: Request processed in 180us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778943.501852:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:2.0:1790778943.505806:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778943.505929:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642678912 00000100:00100000:0.0:1790778943.505943:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642678912 00000100:00100000:0.0:1790778943.506017:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:0.0:1790778943.506029:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6156:x1877767642678912:12345-192.168.203.3@tcp:501: 00000100:00100000:0.0:1790778943.506413:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6156:x1877767642678912:12345-192.168.203.3@tcp:501: Request processed in 385us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778943.506422:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:1.0:1790778943.509425:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778943.509631:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642679040 00000100:00100000:2.0:1790778943.509644:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642679040 00000100:00100000:2.0:1790778943.509761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:2.0:1790778943.509774:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6156:x1877767642679040:12345-192.168.203.3@tcp:503: 00000100:00100000:2.0:1790778943.510023:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6156:x1877767642679040:12345-192.168.203.3@tcp:503: Request processed in 251us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778943.510041:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:3.0:1790778943.512921:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778943.513837:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642679168 00000100:00100000:0.0:1790778943.513855:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642679168 00000100:00100000:0.0:1790778943.513933:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:0.0:1790778943.514616:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6180:x1877767642679168:12345-192.168.203.3@tcp:502: 00000100:00100000:0.0:1790778943.514840:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6180:x1877767642679168:12345-192.168.203.3@tcp:502: Request processed in 895us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778943.514863:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:3.0:1790778943.517162:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778943.517799:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642679296 00000100:00100000:2.0:1790778943.517813:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642679296 00000100:00100000:2.0:1790778943.517975:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 194 00000100:00100000:2.0:1790778943.517987:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6180:x1877767642679296:12345-192.168.203.3@tcp:502: 00000100:00100000:2.0:1790778943.518188:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6180:x1877767642679296:12345-192.168.203.3@tcp:502: Request processed in 202us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778943.518197:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 194 00000100:00100000:1.0:1790778943.522017:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778943.522057:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778943.522169:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642679424 00000100:00100000:0.0:1790778943.522182:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642679424 00000100:00100000:0.0:1790778943.522247:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642679680 00000100:00100000:0.0:1790778943.522250:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642679680 00000100:00100000:0.0:1790778943.522267:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1790778943.522277:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1877767642679424:12345-192.168.203.3@tcp:38: 00010000:00080000:0.0:1790778943.522312:0:6525:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:0.0:1790778943.522386:0:6525:0:(genops.c:1384:class_connect()) connect: client e5203316-d1cf-49fe-9b64-c701aab9b690, cookie 0xb1aa4014e936cb4e 00000004:00100000:0.0:1790778943.522419:0:6525:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790778943.522711:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9b760322e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790778943.522802:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2397:x1877767642679424:12345-192.168.203.3@tcp:38: Request processed in 525us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778943.522812:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1790778943.522834:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:0.0:1790778943.522840:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1877767642679680:12345-192.168.203.3@tcp:38: 00010000:00080000:0.0:1790778943.522857:0:6525:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:0.0:1790778943.522929:0:6525:0:(genops.c:1384:class_connect()) connect: client e5203316-d1cf-49fe-9b64-c701aab9b690, cookie 0xb1aa4014e936cb55 00000004:00100000:0.0:1790778943.522945:0:6525:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790778943.523103:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9b76035f5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790778943.523131:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2397:x1877767642679680:12345-192.168.203.3@tcp:38: Request processed in 290us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778943.523139:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1790778944.105036:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778944.105406:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663698304:0@lo:41: 00000100:00100000:3.0:1790778944.105504:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778944.105609:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663698304 00000100:00100000:1.0:1790778944.105621:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663698304 00000100:00100000:1.0:1790778944.105772:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790778944.105787:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663698304:12345-0@lo:41: 00000004:00000024:1.0:1790778944.105831:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1790778944.105910:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663698304:12345-0@lo:41: Request processed in 127us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778944.105919:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790778944.106017:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663698304:0@lo:41: 00010000:00010000:3.0:1790778944.424411:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778944.534679:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778944.534736:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778944.534777:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778944.534920:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642679936 00000100:00100000:3.0:1790778944.534934:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642679936 00000100:00100000:3.0:1790778944.535012:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642679552 00000100:00100000:3.0:1790778944.535016:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642679552 00000100:00100000:3.0:1790778944.535031:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642679808 00000100:00100000:3.0:1790778944.535033:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642679808 00000100:00100000:3.0:1790778944.535068:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1790778944.535080:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:6156:x1877767642679936:12345-192.168.203.3@tcp:41: 00000004:00000024:3.0:1790778944.535122:0:6523:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1790778944.535231:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:6156:x1877767642679936:12345-192.168.203.3@tcp:41: Request processed in 153us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778944.535240:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:1.0:1790778944.535263:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:1.0:1790778944.535277:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:0:x1877767642679552:12345-192.168.203.3@tcp:41: 00000004:00000024:1.0:1790778944.535294:0:6524:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:2.0:1790778944.535301:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790778944.535317:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778944.535322:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:0:x1877767642679552:12345-192.168.203.3@tcp:41: Request processed in 48us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778944.536955:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:1.0:1790778944.536995:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:1.0:1790778944.537016:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:0:x1877767642679808:12345-192.168.203.3@tcp:41: 00000004:00000024:1.0:1790778944.537062:0:6524:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790778944.537159:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:0:x1877767642679808:12345-192.168.203.3@tcp:41: Request processed in 153us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778944.537166:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:2.0:1790778944.551530:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778944.551694:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642680064 00000100:00100000:0.0:1790778944.551853:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642680064 00000100:00100000:0.0:1790778944.552036:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:0.0:1790778944.552049:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6156:x1877767642680064:12345-192.168.203.3@tcp:40: 00000100:00100000:0.0:1790778944.552187:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6156:x1877767642680064:12345-192.168.203.3@tcp:40: Request processed in 130us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778944.552195:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:1.0:1790778944.563403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778944.563524:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778944.563558:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778944.563615:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778944.563853:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642680192 00000100:00100000:3.0:1790778944.563868:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642680192 00000100:00100000:3.0:1790778944.563935:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642680320 00000100:00100000:3.0:1790778944.563939:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642680320 00000100:00100000:3.0:1790778944.563971:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1790778944.563982:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1877767642680192:12345-192.168.203.3@tcp:8: 00010000:00080000:3.0:1790778944.564028:0:8855:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1790778944.564064:0:8855:0:(genops.c:1384:class_connect()) connect: client e5203316-d1cf-49fe-9b64-c701aab9b690, cookie 0xb1aa4014e936cb5c 00002000:00100000:3.0:1790778944.564081:0:8855:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e5203316-d1cf-49fe-9b64-c701aab9b690/ffff9b76038f3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790778944.564123:0:8855:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790778944.564365:0:8855:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790778944.564405:0:8855:0:(import.c:65:import_set_state_nolock()) ffff9b76038f5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778944.564491:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2397:x1877767642680192:12345-192.168.203.3@tcp:8: Request processed in 509us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778944.564499:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1790778944.564519:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1790778944.564524:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1877767642680320:12345-192.168.203.3@tcp:8: 00010000:00080000:3.0:1790778944.564543:0:8855:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1790778944.564560:0:8855:0:(genops.c:1384:class_connect()) connect: client e5203316-d1cf-49fe-9b64-c701aab9b690, cookie 0xb1aa4014e936cb63 00002000:00100000:3.0:1790778944.564565:0:8855:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e5203316-d1cf-49fe-9b64-c701aab9b690/ffff9b76038f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790778944.564579:0:8855:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790778944.564730:0:8855:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790778944.564752:0:8855:0:(import.c:65:import_set_state_nolock()) ffff9b76038f0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778944.564778:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2397:x1877767642680320:12345-192.168.203.3@tcp:8: Request processed in 251us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778944.564784:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:0.0:1790778944.565562:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642680576 00000100:00100000:0.0:1790778944.565572:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642680576 00000100:00100000:0.0:1790778944.565639:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:0.0:1790778944.565649:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2398:x1877767642680576:12345-192.168.203.3@tcp:400: 00000100:00100000:0.0:1790778944.565709:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2398:x1877767642680576:12345-192.168.203.3@tcp:400: Request processed in 62us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778944.565716:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:2.0:1790778944.566422:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642680448 00000100:00100000:2.0:1790778944.566430:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642680448 00000100:00100000:2.0:1790778944.566509:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:2.0:1790778944.566519:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6156:x1877767642680448:12345-192.168.203.3@tcp:900: 00000100:00100000:2.0:1790778944.566590:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6156:x1877767642680448:12345-192.168.203.3@tcp:900: Request processed in 73us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778944.566598:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1790778944.568035:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778944.568269:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642680704 00000100:00100000:0.0:1790778944.568277:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642680704 00000100:00100000:0.0:1790778944.568381:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1790778944.568393:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6156:x1877767642680704:12345-192.168.203.3@tcp:33: 00000004:00080000:0.0:1790778944.609586:0:6526:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 41081us 00000004:00200000:0.0:1790778944.631418:0:6526:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790778944.631586:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6156:x1877767642680704:12345-192.168.203.3@tcp:33: Request processed in 63187us (63550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778944.631599:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:1.0:1790778944.795137:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778944.795299:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642680832 00000100:00100000:0.0:1790778944.795313:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642680832 00000100:00100000:0.0:1790778944.795395:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1790778944.795408:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6198:x1877767642680832:12345-192.168.203.3@tcp:101: 00010000:00010000:0.0:1790778944.795437:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778944.795658:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936cb6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4256a7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778944.795742:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936cb71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778944.795756:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936cb71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778944.795769:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936cb71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778944.795811:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790778944.795815:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790778944.795829:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936cb71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778944.795865:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936cb6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256a7 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778944.795938:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936cb71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256a7 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778944.795947:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603614800) 00010000:00010000:0.0:1790778944.795950:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790778944.795954:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769c00, rc 0) 00000100:00100000:0.0:1790778944.796028:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:6198:x1877767642680832:12345-192.168.203.3@tcp:101: Request processed in 622us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778944.796037:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00010000:00010000:0.0:1790778945.448189:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778945.640293:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790778945.640331:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663698432:0@lo:13: 00000100:00100000:1.0:1790778945.640437:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778945.640717:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663698432 00000100:00100000:0.0:1790778945.640734:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663698432 00000100:00100000:0.0:1790778945.640808:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790778945.640820:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663698432:12345-0@lo:13: 00002000:00000024:0.0:1790778945.640850:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778945.640926:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663698432:12345-0@lo:13: Request processed in 109us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778945.640935:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1790778945.641145:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c52300 x1877767663698432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790778945.641163:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778945.641167:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663698432:0@lo:13: 00000100:00100000:3.0:1790778945.641234:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663698560:0@lo:13: 00000100:00100000:3.0:1790778945.641273:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778945.641418:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663698560 00000100:00100000:0.0:1790778945.641424:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663698560 00000100:00100000:0.0:1790778945.641466:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790778945.641474:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663698560:12345-0@lo:13: 00002000:00000024:0.0:1790778945.641488:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778945.641527:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663698560:12345-0@lo:13: Request processed in 53us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778945.641533:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1790778945.641580:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790778945.641634:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c50380 x1877767663698560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778945.641648:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663698560:0@lo:13: 00010000:00010000:3.0:1790778946.472270:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778946.664506:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663698816:0@lo:13: 00000100:00100000:0.0:1790778946.664607:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778946.665665:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790778946.665691:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663698688:0@lo:13: 00000100:00100000:2.0:1790778946.665754:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778946.665825:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663698816 00000100:00100000:2.0:1790778946.665837:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663698816 00000100:00100000:2.0:1790778946.665917:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663698688 00000100:00100000:2.0:1790778946.665921:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663698688 00000100:00100000:2.0:1790778946.665942:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790778946.665952:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663698816:12345-0@lo:13: 00002000:00000024:2.0:1790778946.665992:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1790778946.666270:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778946.666446:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663698944:0@lo:400: 00000100:00100000:3.0:1790778946.666524:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778946.666583:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663699456:0@lo:400: 00000100:00100000:0.0:1790778946.666640:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663699328:0@lo:400: 00000100:00100000:0.0:1790778946.666690:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778946.666723:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663699840:0@lo:400: 00000100:00100000:0.0:1790778946.666751:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778946.667049:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663698944 00000100:00100000:1.0:1790778946.667058:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663698944 00000100:00100000:1.0:1790778946.667108:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1790778946.667117:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663698944:12345-0@lo:400: 00000100:00100000:1.0:1790778946.667173:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663698944:12345-0@lo:400: Request processed in 58us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778946.667207:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1790778946.667391:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778946.667417:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663699968:0@lo:400: 00000100:00100000:3.0:1790778946.667438:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778946.667474:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663698944:0@lo:400: 00000100:00100000:3.0:1790778946.667502:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663699840 00000100:00100000:3.0:1790778946.667505:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663699840 00000100:00100000:3.0:1790778946.667529:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663699968 00000100:00100000:3.0:1790778946.667532:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663699968 00000100:00100000:3.0:1790778946.667546:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790778946.667552:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663699840:12345-0@lo:400: 00000100:00100000:3.0:1790778946.667584:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663699840:12345-0@lo:400: Request processed in 32us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778946.667590:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790778946.667601:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790778946.667607:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663699968:12345-0@lo:400: 00000100:00100000:1.0:1790778946.668848:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663699328 00000100:00100000:1.0:1790778946.668859:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663699328 00000100:00100000:1.0:1790778946.668921:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790778946.668931:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663699328:12345-0@lo:400: 00000100:00100000:3.0:1790778946.669135:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663699968:12345-0@lo:400: Request processed in 1527us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778946.669144:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790778946.669167:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663699456 00000100:00100000:1.0:1790778946.669332:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663699328:12345-0@lo:400: Request processed in 402us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778946.669339:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790778946.669393:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663699200:0@lo:400: 00000100:00100000:1.0:1790778946.669423:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778946.669443:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663699712:0@lo:400: 00000100:00100000:1.0:1790778946.669463:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778946.669484:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663700224:0@lo:400: 00000100:00100000:1.0:1790778946.669503:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778946.669518:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790778946.669524:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663699072:0@lo:400: 00000100:00100000:1.0:1790778946.669541:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778946.669550:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1877767663699584:0@lo:400: 00000100:00100000:1.0:1790778946.669568:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778946.669576:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663700096:0@lo:400: 00000100:00100000:1.0:1790778946.669591:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778946.669610:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663699200 00000100:00100000:1.0:1790778946.669625:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663699200 00000100:00100000:3.0:1790778946.669731:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663699456 00000100:00100000:3.0:1790778946.669849:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790778946.669858:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663699456:12345-0@lo:400: 00000100:00100000:3.0:1790778946.669915:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663699456:12345-0@lo:400: Request processed in 59us (2524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778946.669934:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790778946.670048:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663698816:12345-0@lo:13: Request processed in 4088us (5432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778946.670063:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790778946.670099:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790778946.670114:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663698688:12345-0@lo:13: 00002000:00000024:2.0:1790778946.670143:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778946.670273:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663698688:12345-0@lo:13: Request processed in 165us (4518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778946.670280:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790778946.670337:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c51c00 x1877767663698688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778946.670350:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790778946.670538:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663698688:0@lo:13: 00000100:00100000:2.0:1790778946.670593:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663699712 00000100:00100000:2.0:1790778946.670601:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663699712 00000100:00100000:2.0:1790778946.670646:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663700224 00000100:00100000:2.0:1790778946.670650:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663700224 00000100:00100000:2.0:1790778946.670662:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663699072 00000100:00100000:2.0:1790778946.670665:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663699072 00000100:00100000:2.0:1790778946.670675:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663699584 00000100:00100000:2.0:1790778946.670677:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663699584 00000100:00100000:2.0:1790778946.670688:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663700096 00000100:00100000:2.0:1790778946.670705:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663700096 00000100:00100000:2.0:1790778946.670725:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790778946.670732:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663699712:12345-0@lo:400: 00000100:00100000:3.0:1790778946.670783:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663699456:0@lo:400: 00000100:00100000:1.0:1790778946.670894:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790778946.670902:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663699200:12345-0@lo:400: 00000100:00100000:2.0:1790778946.671054:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663699712:12345-0@lo:400: Request processed in 320us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778946.671062:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790778946.671078:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790778946.671086:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663700224:12345-0@lo:400: 00000100:00100000:2.0:1790778946.671121:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663700224:12345-0@lo:400: Request processed in 36us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778946.671127:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790778946.671138:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790778946.671144:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663699072:12345-0@lo:400: 00000100:00100000:2.0:1790778946.671253:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663699072:12345-0@lo:400: Request processed in 108us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778946.671261:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790778946.671274:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790778946.671281:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1877767663699584:12345-0@lo:400: 00000100:00100000:2.0:1790778946.671312:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1877767663699584:12345-0@lo:400: Request processed in 33us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778946.671318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790778946.671329:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790778946.671335:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663700096:12345-0@lo:400: 00000100:00100000:2.0:1790778946.671362:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663700096:12345-0@lo:400: Request processed in 28us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778946.671369:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1790778946.671731:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790778946.671738:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790778946.671775:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663699072:0@lo:400: 00000100:00100000:2.0:1790778946.671791:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1877767663699584:0@lo:400: 00000100:00100000:2.0:1790778946.671802:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663700096:0@lo:400: 00010000:00080000:2.0:1790778946.671817:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603841f80 x1877767663699712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778946.671829:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663699712:0@lo:400: 00010000:00080000:2.0:1790778946.671843:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c0ed80 x1877767663700224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778946.671852:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663700224:0@lo:400: 00010000:00080000:3.0:1790778946.675075:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760300aa00 x1877767663699968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778946.675094:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663699968:0@lo:400: 00010000:00080000:0.0:1790778946.676001:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603745180 x1877767663698816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778946.676263:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663698816:0@lo:13: 00000100:00100000:0.0:1790778946.676321:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663699328:0@lo:400: 00010000:00080000:0.0:1790778946.676335:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603009880 x1877767663699840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778946.676368:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663699840:0@lo:400: 00000100:00100000:1.0:1790778946.682052:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663699200:12345-0@lo:400: Request processed in 11143us (12620us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778946.682067:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790778946.684015:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663699200:0@lo:400: 00000100:00100000:2.0:1790778946.881905:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778946.882814:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642680960 00000100:00100000:3.0:1790778946.882828:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642680960 00000100:00100000:3.0:1790778946.883001:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1790778946.883012:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:6250:x1877767642680960:12345-192.168.203.3@tcp:41: 00000004:00000024:3.0:1790778946.883049:0:6523:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1790778946.883118:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:6250:x1877767642680960:12345-192.168.203.3@tcp:41: Request processed in 108us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778946.883125:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1790778946.886367:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778946.886444:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642681088 00000100:00100000:0.0:1790778946.886455:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642681088 00000100:00080000:2.0:1790778946.887795:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790778946.887802:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778946.889450:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:0.0:1790778946.889539:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6250:x1877767642681088:12345-192.168.203.3@tcp:41: 00000004:00000024:0.0:1790778946.889583:0:6524:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790778946.890002:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6250:x1877767642681088:12345-192.168.203.3@tcp:41: Request processed in 540us (3650us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778946.890010:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1790778946.903546:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778946.903693:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642681216 00000100:00100000:1.0:1790778946.903703:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642681216 00000100:00100000:1.0:1790778946.903844:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1790778946.903856:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6250:x1877767642681216:12345-192.168.203.3@tcp:13: 00002000:00000024:1.0:1790778946.903912:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778946.903997:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6250:x1877767642681216:12345-192.168.203.3@tcp:13: Request processed in 143us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778946.904004:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00080000:2.0:1790778946.907253:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778946.910098:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778946.910842:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642681344 00000100:00100000:0.0:1790778946.910853:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642681344 00000100:00100000:0.0:1790778946.910973:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:0.0:1790778946.910984:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6250:x1877767642681344:12345-192.168.203.3@tcp:13: 00002000:00000024:0.0:1790778946.911010:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778946.911075:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e5203316-d1cf-49fe-9b64-c701aab9b690+6:6250:x1877767642681344:12345-192.168.203.3@tcp:13: Request processed in 93us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778946.911083:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00080000:2.0:1790778946.911829:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778947.177352:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778947.177378:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663700352:0@lo:41: 00000100:00100000:3.0:1790778947.177441:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778947.180414:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663700352 00000100:00100000:2.0:1790778947.180428:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663700352 00000100:00100000:2.0:1790778947.180487:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790778947.180497:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663700352:12345-0@lo:41: 00000004:00000024:2.0:1790778947.180532:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790778947.180627:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663700352:12345-0@lo:41: Request processed in 131us (3184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778947.180634:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790778947.185625:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663700352:0@lo:41: 00000001:00100000:1.0:1790778947.187716:0:9517:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000001:00080000:1.0:1790778947.187736:0:9517:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1790778947.496152:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778948.520139:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790778948.715369:0:6502:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000001:00100000:3.0:1790778948.715454:0:7455:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000100:00100000:3.0:1790778949.224101:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663700480:0@lo:41: 00000100:00100000:3.0:1790778949.224193:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778949.224300:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663700480 00000100:00100000:0.0:1790778949.224308:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663700480 00000100:00100000:0.0:1790778949.224367:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790778949.224378:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663700480:12345-0@lo:41: 00000004:00000024:0.0:1790778949.224423:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1790778949.224477:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663700480:12345-0@lo:41: Request processed in 101us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778949.224500:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790778949.224735:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663700480:0@lo:41: 00010000:00010000:0.0:1790778949.544019:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790778949.738569:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000100:00100000:3.0:1790778949.809968:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778949.810008:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778949.810503:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642681472 00000100:00100000:2.0:1790778949.810513:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642681472 00000100:00100000:2.0:1790778949.810565:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 197 00000100:00100000:2.0:1790778949.810575:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2400:x1877767642681472:12345-192.168.203.3@tcp:400: 00000100:00100000:2.0:1790778949.810644:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2400:x1877767642681472:12345-192.168.203.3@tcp:400: Request processed in 70us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778949.810651:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 197 00000100:00100000:3.0:1790778949.811105:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778949.811979:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778949.813387:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778949.814160:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642681600 00000100:00100000:3.0:1790778949.817239:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642681600 00000100:00080000:0.0:1790778949.817371:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778949.820346:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642681728 00000100:00100000:2.0:1790778949.820358:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642681728 00000100:00080000:2.0:1790778949.820470:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790778949.823209:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642681856 00000100:00100000:3.0:1790778949.823223:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642681856 00000100:00100000:3.0:1790778949.823277:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642681984 00000100:00100000:3.0:1790778949.823281:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642681984 00000100:00100000:3.0:1790778949.823309:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1790778949.823320:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642681856:12345-192.168.203.3@tcp:400: 00000100:00100000:3.0:1790778949.823394:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642681856:12345-192.168.203.3@tcp:400: Request processed in 76us (12251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778949.823402:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1790778949.823417:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1790778949.823423:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642681984:12345-192.168.203.3@tcp:400: 00000100:00100000:3.0:1790778949.823767:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642681984:12345-192.168.203.3@tcp:400: Request processed in 342us (10386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778949.823775:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1790778949.823802:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:3.0:1790778949.823811:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642681600:12345-192.168.203.3@tcp:400: 00000100:00100000:3.0:1790778949.823841:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642681600:12345-192.168.203.3@tcp:400: Request processed in 32us (13832us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778949.823862:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00080000:2.0:1790778949.823935:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790778949.823940:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778949.823951:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:2.0:1790778949.823960:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642681728:12345-192.168.203.3@tcp:400: 00000100:00100000:2.0:1790778949.823995:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642681728:12345-192.168.203.3@tcp:400: Request processed in 37us (12891us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778949.824001:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000001:02000400:0.0:1790778949.864544:0:10186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790778950.568542:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778950.760198:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778950.760226:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663700736:0@lo:13: 00000100:00100000:1.0:1790778950.760293:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778950.760341:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663700736 00000100:00100000:2.0:1790778950.760350:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663700736 00000100:00100000:1.0:1790778950.760364:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663700608:0@lo:13: 00000100:00100000:1.0:1790778950.760393:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778950.760403:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663700608 00000100:00100000:2.0:1790778950.760407:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663700608 00000100:00100000:2.0:1790778950.760433:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790778950.760443:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663700736:12345-0@lo:13: 00002000:00000024:2.0:1790778950.760470:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1790778950.760481:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778950.760544:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663700736:12345-0@lo:13: Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778950.760552:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790778950.760579:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790778950.760599:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663700608:12345-0@lo:13: 00002000:00000024:2.0:1790778950.760610:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778950.760638:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663700608:12345-0@lo:13: Request processed in 40us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778950.760644:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1790778950.760924:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c51f80 x1877767663700736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778950.760942:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663700736:0@lo:13: 00010000:00080000:1.0:1790778950.760953:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c50700 x1877767663700608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778950.760976:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663700608:0@lo:13: 00010000:00010000:0.0:1790778951.592033:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778951.785378:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663700864:0@lo:13: 00000100:00100000:0.0:1790778951.785453:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778951.786495:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663701248:0@lo:400: 00000100:00100000:1.0:1790778951.786547:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778951.786744:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663701760:0@lo:400: 00000100:00100000:1.0:1790778951.786772:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778951.786789:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663702272:0@lo:400: 00000100:00100000:1.0:1790778951.786808:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778951.786828:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790778951.786834:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663701120:0@lo:400: 00000100:00100000:1.0:1790778951.787227:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778951.787246:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1877767663701632:0@lo:400: 00000100:00100000:3.0:1790778951.787263:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663701760 00000100:00100000:1.0:1790778951.787264:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778951.787271:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663701760 00000100:00100000:1.0:1790778951.787279:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663702144:0@lo:400: 00000100:00100000:1.0:1790778951.787297:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778951.787315:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663702272 00000100:00100000:3.0:1790778951.787318:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663702272 00000100:00100000:3.0:1790778951.787331:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663701120 00000100:00100000:3.0:1790778951.787334:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663701120 00000100:00100000:3.0:1790778951.787345:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663701632 00000100:00100000:3.0:1790778951.787347:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663701632 00000100:00100000:3.0:1790778951.787358:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663702144 00000100:00100000:3.0:1790778951.787360:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663702144 00000100:00100000:3.0:1790778951.787375:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790778951.787383:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663701760:12345-0@lo:400: 00000100:00100000:3.0:1790778951.787439:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663701760:12345-0@lo:400: Request processed in 56us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778951.787446:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790778951.787462:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790778951.787467:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663702272:12345-0@lo:400: 00000100:00100000:3.0:1790778951.787491:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663702272:12345-0@lo:400: Request processed in 24us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778951.787496:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790778951.787505:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790778951.787510:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663701120:12345-0@lo:400: 00000100:00100000:3.0:1790778951.787533:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663701120:12345-0@lo:400: Request processed in 23us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778951.787538:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790778951.787559:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790778951.787565:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1877767663701632:12345-0@lo:400: 00000100:00100000:3.0:1790778951.787605:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1877767663701632:12345-0@lo:400: Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778951.787611:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790778951.787623:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790778951.787629:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663702144:12345-0@lo:400: 00000100:00100000:3.0:1790778951.787655:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663702144:12345-0@lo:400: Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778951.787660:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1790778951.787674:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790778951.787678:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790778951.787733:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663701120:0@lo:400: 00000100:00100000:3.0:1790778951.787744:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1877767663701632:0@lo:400: 00000100:00100000:3.0:1790778951.787753:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663702144:0@lo:400: 00010000:00080000:3.0:1790778951.787763:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c0c380 x1877767663701760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778951.787772:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663701760:0@lo:400: 00010000:00080000:3.0:1790778951.787786:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603964e00 x1877767663702272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778951.787794:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663702272:0@lo:400: 00000100:00100000:0.0:1790778951.787906:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663701376:0@lo:400: 00000100:00100000:0.0:1790778951.787936:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778951.787962:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663701888:0@lo:400: 00000100:00100000:0.0:1790778951.787984:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778951.787998:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663702400:0@lo:400: 00000100:00100000:0.0:1790778951.788032:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778951.788057:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790778951.788062:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663700992:0@lo:400: 00000100:00100000:0.0:1790778951.788087:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778951.788110:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663701504:0@lo:400: 00000100:00100000:0.0:1790778951.788132:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778951.788148:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663702016:0@lo:400: 00000100:00100000:0.0:1790778951.788178:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778951.788210:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663700864 00000100:00100000:0.0:1790778951.788215:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663700864 00000100:00100000:0.0:1790778951.788246:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790778951.788254:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663700864:12345-0@lo:13: 00002000:00000024:0.0:1790778951.788275:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778951.788311:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663700864:12345-0@lo:13: Request processed in 58us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778951.788324:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790778951.788348:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663701248 00000100:00100000:0.0:1790778951.788352:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663701248 00000100:00100000:0.0:1790778951.788368:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663701504 00000100:00100000:0.0:1790778951.788371:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663701504 00000100:00100000:0.0:1790778951.788383:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790778951.788389:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663701248:12345-0@lo:400: 00000100:00100000:0.0:1790778951.788425:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663701248:12345-0@lo:400: Request processed in 36us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778951.788431:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790778951.788443:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790778951.788449:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663701504:12345-0@lo:400: 00000100:00100000:0.0:1790778951.788476:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663701504:12345-0@lo:400: Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778951.788482:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790778951.788498:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663700992 00000100:00100000:0.0:1790778951.788501:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663700992 00000100:00100000:0.0:1790778951.788521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790778951.788528:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663700992:12345-0@lo:400: 00000100:00100000:0.0:1790778951.788557:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663700992:12345-0@lo:400: Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778951.788563:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790778951.788587:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663701888 00000100:00100000:0.0:1790778951.788590:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663701888 00000100:00100000:0.0:1790778951.788611:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663702400 00000100:00100000:0.0:1790778951.788614:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663702400 00000100:00100000:0.0:1790778951.788626:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663702016 00000100:00100000:0.0:1790778951.788628:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663702016 00000100:00100000:0.0:1790778951.788651:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790778951.788657:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663701888:12345-0@lo:400: 00000100:00100000:0.0:1790778951.788688:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663701888:12345-0@lo:400: Request processed in 32us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778951.788694:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790778951.788706:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790778951.788712:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663702400:12345-0@lo:400: 00000100:00100000:0.0:1790778951.788737:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663702400:12345-0@lo:400: Request processed in 26us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778951.788742:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790778951.788752:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790778951.788757:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663702016:12345-0@lo:400: 00000100:00100000:0.0:1790778951.788782:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663702016:12345-0@lo:400: Request processed in 25us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778951.788787:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790778951.788827:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663700992:0@lo:400: 00000100:00100000:0.0:1790778951.788838:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663701504:0@lo:400: 00010000:00080000:0.0:1790778951.788848:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c0d880 x1877767663702016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778951.788857:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663702016:0@lo:400: 00010000:00080000:0.0:1790778951.788866:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c0ed80 x1877767663701888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778951.788873:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663701888:0@lo:400: 00010000:00080000:0.0:1790778951.788905:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603964000 x1877767663702400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778951.788921:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663702400:0@lo:400: 00010000:00080000:0.0:1790778951.788935:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603746a00 x1877767663700864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778951.788942:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1790778951.788958:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663700864:0@lo:13: 00000100:00100000:2.0:1790778951.789771:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663701376 00000100:00100000:2.0:1790778951.789779:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663701376 00000100:00100000:2.0:1790778951.789812:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790778951.789820:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663701376:12345-0@lo:400: 00000100:00100000:2.0:1790778951.789906:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663701376:12345-0@lo:400: Request processed in 86us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778951.789912:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790778951.790147:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663701376:0@lo:400: 00000100:00100000:0.0:1790778951.790966:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778951.790979:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663702528:0@lo:13: 00000100:00100000:0.0:1790778951.791023:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778951.791060:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663702528 00000100:00100000:0.0:1790778951.791064:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663702528 00000100:00100000:0.0:1790778951.791096:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790778951.791102:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663702528:12345-0@lo:13: 00002000:00000024:0.0:1790778951.791119:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1790778951.791375:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778951.791410:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663701248:0@lo:400: 00000100:00100000:0.0:1790778951.791559:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663702528:12345-0@lo:13: Request processed in 456us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778951.791566:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1790778951.791670:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603912d80 x1877767663702528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778951.791685:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663702528:0@lo:13: 00000100:00100000:1.0:1790778952.297803:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778952.297840:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663702656:0@lo:41: 00000100:00100000:1.0:1790778952.297960:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778952.298043:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663702656 00000100:00100000:1.0:1790778952.298053:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663702656 00000100:00100000:1.0:1790778952.298111:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790778952.298121:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663702656:12345-0@lo:41: 00000004:00000024:1.0:1790778952.298177:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790778952.298231:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663702656:12345-0@lo:41: Request processed in 111us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778952.298249:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790778952.298309:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663702656:0@lo:41: 00010000:00010000:3.0:1790778952.616088:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778953.641003:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790778953.918847:0:10333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7b3fe520 20000000:00000080:3.0:1790778953.918872:0:10333:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b7603805000 uarg=0000000000000000 20000000:01000000:3.0:1790778953.919042:0:10333:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1790778953.919045:0:10333:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1790778953.919048:0:10333:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790778953.919055:0:10333:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790778953.919207:0:10333:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1790778953.919294:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1790778953.919298:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790778953.920018:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1790778953.920361:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1790778953.920398:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1790778953.920415:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1790778953.920426:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790778953.920428:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790778953.921030:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1790778953.921352:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1790778953.921374:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1790778953.921387:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1790778953.921395:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790778953.921397:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790778953.921799:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1790778953.922029:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1790778953.922049:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1790778953.922389:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1790778953.922405:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790778953.922408:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790778953.922807:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1790778953.924203:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1790778953.924247:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1790778953.924261:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1790778953.924272:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790778953.924275:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790778953.924785:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1790778953.925866:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1790778953.926229:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1790778953.926249:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:3.0:1790778953.926269:0:10333:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790778953.926304:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926329:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936ca13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca0c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926338:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e6600/0xb1aa4014e936ca3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca36 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926345:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ca7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca75 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926352:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936ca8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca83 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926360:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca91 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926368:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936caad expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926375:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936cade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cad7 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926382:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7742148800/0xb1aa4014e936cafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936caf3 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926389:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cb1d expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926399:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425637 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926417:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77055cf400/0xb1aa4014e936cb39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42563e expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926426:0:10333:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926480:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77055cf400/0xb1aa4014e936cb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42563e expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926501:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b77055cf400/0xb1aa4014e936cb39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42563e expref: 9 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.926585:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663702784:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790778953.926766:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425637 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926776:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cb32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425637 expref: 9 pid: 6515 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.926785:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663702912:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790778953.926817:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936cb1d expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926827:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cb24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936cb1d expref: 23 pid: 6517 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.926837:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703040:0@lo:104: 00000100:00100000:3.0:1790778953.926928:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790778953.926980:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7742148800/0xb1aa4014e936cafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936caf3 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.926989:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7742148800/0xb1aa4014e936cafa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936caf3 expref: 23 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.926997:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703168:0@lo:104: 00000100:00100000:3.0:1790778953.927019:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790778953.927044:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936cade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936cad7 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.927053:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936cade lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936cad7 expref: 23 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.927070:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703296:0@lo:104: 00000100:00100000:3.0:1790778953.927090:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790778953.927116:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936caad expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.927125:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936caad expref: 23 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.927133:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703424:0@lo:104: 00000100:00100000:3.0:1790778953.927165:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790778953.927182:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936ca91 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.927190:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936ca91 expref: 23 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.927198:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703552:0@lo:104: 00010000:00010000:3.0:1790778953.927231:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936ca8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936ca83 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.927239:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936ca8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936ca83 expref: 23 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.927247:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703680:0@lo:104: 00010000:00010000:3.0:1790778953.927284:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ca7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936ca75 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.927293:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ca7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936ca75 expref: 23 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.927301:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703808:0@lo:104: 00010000:00010000:3.0:1790778953.927322:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e6600/0xb1aa4014e936ca3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936ca36 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.927329:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77089e6600/0xb1aa4014e936ca3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936ca36 expref: 23 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.927337:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703936:0@lo:104: 00010000:00010000:3.0:1790778953.927358:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936ca13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936ca0c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.927365:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936ca13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936ca0c expref: 23 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.927372:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663704064:0@lo:104: 00000100:00100000:3.0:1790778953.927390:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78540 going to sleep for 11 seconds 00000100:00100000:2.0:1790778953.927572:0:6507:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790778953.927594:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778953.927609:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778953.927617:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778953.927626:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778953.927634:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778953.927643:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663703040 00000100:00100000:2.0:1790778953.927651:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663703040 00000100:00100000:2.0:1790778953.927697:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663703168 00000100:00100000:2.0:1790778953.927700:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663703168 00000100:00100000:2.0:1790778953.927711:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663703296 00000100:00100000:2.0:1790778953.927713:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663703296 00000100:00100000:2.0:1790778953.927732:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663703424 00000100:00100000:2.0:1790778953.927735:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663703424 00000100:00100000:2.0:1790778953.927745:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663703552 00000100:00100000:2.0:1790778953.927748:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663703552 00000100:00100000:2.0:1790778953.927771:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663703680 00000100:00100000:2.0:1790778953.927774:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663703680 00000100:00100000:2.0:1790778953.927785:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663703808 00000100:00100000:2.0:1790778953.927787:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663703808 00000100:00100000:2.0:1790778953.927796:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663703936 00000100:00100000:2.0:1790778953.927798:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663703936 00000100:00100000:2.0:1790778953.927805:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663704064 00000100:00100000:2.0:1790778953.927807:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663704064 00000100:00100000:2.0:1790778953.927821:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790778953.927830:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+11:10333:x1877767663703040:12345-0@lo:104: 00010000:00010000:2.0:1790778953.927846:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.927961:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790778953.927968:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+11:10333:x1877767663703040:12345-0@lo:104: Request processed in 140us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.927975:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790778953.927995:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790778953.928000:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+10:10333:x1877767663703168:12345-0@lo:104: 00010000:00010000:2.0:1790778953.928008:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.928039:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790778953.928043:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+10:10333:x1877767663703168:12345-0@lo:104: Request processed in 44us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.928049:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790778953.928068:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790778953.928073:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+9:10333:x1877767663703296:12345-0@lo:104: 00010000:00010000:2.0:1790778953.928081:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.928234:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790778953.928242:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+9:10333:x1877767663703296:12345-0@lo:104: Request processed in 167us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.928248:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790778953.928274:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790778953.928281:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b71a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+8:10333:x1877767663703424:12345-0@lo:104: 00010000:00010000:2.0:1790778953.928288:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.928317:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790778953.928321:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b71a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+8:10333:x1877767663703424:12345-0@lo:104: Request processed in 42us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.928327:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790778953.928362:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790778953.928368:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+7:10333:x1877767663703552:12345-0@lo:104: 00010000:00010000:2.0:1790778953.928376:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.928401:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1790778953.928406:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+7:10333:x1877767663703552:12345-0@lo:104: Request processed in 39us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.928412:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790778953.928431:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790778953.928436:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+6:10333:x1877767663703680:12345-0@lo:104: 00010000:00010000:2.0:1790778953.928444:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.928471:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1790778953.928476:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+6:10333:x1877767663703680:12345-0@lo:104: Request processed in 41us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.928481:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790778953.928490:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790778953.928495:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+5:10333:x1877767663703808:12345-0@lo:104: 00010000:00010000:2.0:1790778953.928502:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.928639:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703040:0@lo:104: 00000100:00100000:3.0:1790778953.928649:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703168:0@lo:104: 00000100:00100000:3.0:1790778953.928656:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703296:0@lo:104: 00000100:00100000:3.0:1790778953.928663:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703424:0@lo:104: 00000100:00100000:3.0:1790778953.928670:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703552:0@lo:104: 00000100:00100000:3.0:1790778953.928677:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703680:0@lo:104: 00010000:00010000:2.0:1790778953.928869:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1790778953.928875:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+5:10333:x1877767663703808:12345-0@lo:104: Request processed in 379us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.928901:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790778953.928914:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790778953.928920:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:10333:x1877767663703936:12345-0@lo:104: 00010000:00010000:2.0:1790778953.928928:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.928952:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1790778953.928956:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:10333:x1877767663703936:12345-0@lo:104: Request processed in 37us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.928961:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790778953.928981:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790778953.928987:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:10333:x1877767663704064:12345-0@lo:104: 00010000:00010000:2.0:1790778953.928995:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929023:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1790778953.929027:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:10333:x1877767663704064:12345-0@lo:104: Request processed in 41us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.929032:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1790778953.929051:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1790778953.929070:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929078:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778953.929083:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929092:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778953.929100:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778953.929115:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778953.929164:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929171:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778953.929195:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929214:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718769400/0xb1aa4014e936cb1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cb24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929229:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1790778953.929233:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929239:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742148000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778953.929242:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929250:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778953.929256:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778953.929261:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778953.929274:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929280:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778953.929293:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929300:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936caf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cafa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929312:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1790778953.929320:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929326:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b600 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778953.929328:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929335:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778953.929341:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778953.929346:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778953.929359:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929365:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778953.929370:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929377:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894b600/0xb1aa4014e936cad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cade expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929386:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790778953.929389:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929395:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e7e00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778953.929398:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929415:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778953.929422:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778953.929428:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778953.929443:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929448:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778953.929454:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929460:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77089e7e00/0xb1aa4014e936caad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cab4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929470:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790778953.929472:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929478:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778953.929480:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929487:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778953.929493:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778953.929505:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778953.929760:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929768:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778953.929773:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929780:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ca91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca98 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929791:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790778953.929794:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929800:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768800 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778953.929803:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929810:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778953.929817:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778953.929822:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778953.929909:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929916:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778953.929928:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929934:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ca83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca8a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929943:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790778953.929946:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929952:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768a00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778953.929955:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.929962:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778953.929968:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778953.929973:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1790778953.934373:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703808:0@lo:104: 00000100:00100000:3.0:1790778953.934394:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663703936:0@lo:104: 00000100:00100000:3.0:1790778953.934404:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663704064:0@lo:104: 00000100:00100000:1.0:1790778953.934657:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778953.934763:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778953.935083:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663702784:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790778953.935095:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1877767663702912:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790778953.935172:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778953.935449:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663704576:0@lo:103: 00000100:00100000:1.0:1790778953.935530:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778953.935599:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790778953.935607:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663704192:0@lo:103: 00000100:00100000:1.0:1790778953.935630:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778953.935649:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663704704:0@lo:103: 00000100:00100000:1.0:1790778953.935669:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778953.935693:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1790778953.936035:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642682112 00000100:00100000:3.0:1790778953.936045:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642682112 00010000:00010000:3.0:1790778953.936099:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77055cf400/0xb1aa4014e936cb39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42563e expref: 10 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.936134:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642682240 00000100:00100000:3.0:1790778953.936145:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642682240 00010000:00010000:3.0:1790778953.936158:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cb32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425637 expref: 11 pid: 6515 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.936169:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663704576 00000100:00100000:3.0:1790778953.936171:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663704576 00010000:00010000:3.0:1790778953.936182:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936caad expref: 24 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.936213:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663704192 00000100:00100000:3.0:1790778953.936216:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663704192 00010000:00010000:3.0:1790778953.936227:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cb24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cb1d expref: 25 pid: 6517 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.936237:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663704704 00000100:00100000:3.0:1790778953.936239:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663704704 00010000:00010000:3.0:1790778953.936250:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca91 expref: 26 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.936276:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1790778953.936286:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:2401:x1877767642682112:12345-192.168.203.3@tcp:103: 00010000:00010000:3.0:1790778953.936301:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778953.936308:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77055cf400/0xb1aa4014e936cb39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42563e expref: 11 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.936320:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77055cf400/0xb1aa4014e936cb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42563e expref: 11 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.936341:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cf400/0xb1aa4014e936cb39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42563e expref: 11 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.936358:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778953.936420:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2401:x1877767642682112:12345-192.168.203.3@tcp:103: Request processed in 135us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778953.936428:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1790778953.936478:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1790778953.936486:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603965f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:2401:x1877767642682240:12345-192.168.203.3@tcp:103: 00010000:00010000:3.0:1790778953.936500:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778953.936505:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cb32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425637 expref: 9 pid: 6515 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.936740:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425637 expref: 9 pid: 6515 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.936752:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cb32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425637 expref: 9 pid: 6515 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.936762:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778953.936784:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603965f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:2401:x1877767642682240:12345-192.168.203.3@tcp:103: Request processed in 299us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778953.936791:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1790778953.936805:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790778953.936812:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603966680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+26:3651:x1877767663704576:12345-0@lo:103: 00010000:00010000:3.0:1790778953.936820:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778953.936825:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936caad expref: 26 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.936833:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936caad expref: 26 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.936843:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936caad expref: 26 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.936852:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778953.936930:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603966680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+25:3651:x1877767663704576:12345-0@lo:103: Request processed in 119us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778953.936947:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790778953.936959:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790778953.936965:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603967b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663704192:12345-0@lo:103: 00010000:00010000:3.0:1790778953.936973:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778953.936977:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cb24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cb1d expref: 24 pid: 6517 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.936986:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936cb1d expref: 24 pid: 6517 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.936996:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cb24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936cb1d expref: 24 pid: 6517 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.937004:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778953.937026:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603967b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+23:3651:x1877767663704192:12345-0@lo:103: Request processed in 62us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778953.937032:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790778953.937043:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790778953.937048:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+22:3651:x1877767663704704:12345-0@lo:103: 00010000:00010000:3.0:1790778953.937179:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778953.937185:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca91 expref: 22 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.937194:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936ca91 expref: 22 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.937205:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768000/0xb1aa4014e936ca98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936ca91 expref: 22 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.937223:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778953.937250:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+21:3651:x1877767663704704:12345-0@lo:103: Request processed in 201us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778953.937326:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790778953.937591:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663704192:0@lo:103: 00000100:00100000:1.0:1790778953.937603:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663704704:0@lo:103: 00000100:00100000:1.0:1790778953.937610:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663704576:0@lo:103: 00000100:00100000:3.0:1790778953.938739:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663704448:0@lo:103: 00000100:00100000:3.0:1790778953.938813:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778953.938876:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790778953.938926:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663704320:0@lo:103: 00000100:00100000:3.0:1790778953.938947:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778953.938964:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663704832:0@lo:103: 00000100:00100000:3.0:1790778953.938999:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778953.939041:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663704448 00000100:00100000:3.0:1790778953.939050:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663704448 00000100:00100000:1.0:1790778953.939209:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663704320 00000100:00100000:1.0:1790778953.939213:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663704320 00010000:00010000:1.0:1790778953.939246:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7742148800/0xb1aa4014e936cafa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936caf3 expref: 22 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778953.939269:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663704832 00000100:00100000:1.0:1790778953.939271:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663704832 00010000:00010000:1.0:1790778953.939279:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936ca8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca83 expref: 23 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778953.939311:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790778953.939318:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+23:3650:x1877767663704320:12345-0@lo:103: 00010000:00010000:1.0:1790778953.939332:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778953.939337:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7742148800/0xb1aa4014e936cafa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936caf3 expref: 23 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.939350:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7742148800/0xb1aa4014e936cafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936caf3 expref: 23 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.939369:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7742148800/0xb1aa4014e936cafa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936caf3 expref: 23 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.939386:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778953.939428:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+22:3650:x1877767663704320:12345-0@lo:103: Request processed in 109us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778953.939435:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790778953.939452:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790778953.939458:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+21:3650:x1877767663704832:12345-0@lo:103: 00010000:00010000:1.0:1790778953.939465:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778953.939469:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936ca8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca83 expref: 21 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.939477:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936ca8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936ca83 expref: 21 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.939487:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936ca8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936ca83 expref: 21 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.939506:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778953.939588:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+20:3650:x1877767663704832:12345-0@lo:103: Request processed in 130us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778953.939595:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790778953.939626:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663704320:0@lo:103: 00000100:00100000:1.0:1790778953.939635:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663704832:0@lo:103: 00010000:00010000:3.0:1790778953.939786:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936cade lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cad7 expref: 19 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.939807:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790778953.939814:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+19:3650:x1877767663704448:12345-0@lo:103: 00010000:00010000:3.0:1790778953.939821:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778953.939825:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936cade lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cad7 expref: 19 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.939834:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936cade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936cad7 expref: 19 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.939844:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936cade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936cad7 expref: 19 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.939864:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778953.939913:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+18:3650:x1877767663704448:12345-0@lo:103: Request processed in 100us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778953.939919:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790778953.940017:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663704448:0@lo:103: 00010000:00010000:2.0:1790778953.940285:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.940295:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778953.940312:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.940319:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936ca75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca7c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778953.940333:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778953.940349:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663704960:0@lo:103: 00000100:00100000:2.0:1790778953.940385:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778953.940419:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663704960 00000100:00100000:2.0:1790778953.940424:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663704960 00010000:00010000:2.0:1790778953.940443:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ca7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca75 expref: 18 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778953.940459:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790778953.940465:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+18:3649:x1877767663704960:12345-0@lo:103: 00010000:00010000:2.0:1790778953.940473:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778953.940476:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ca7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca75 expref: 18 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.940484:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ca7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936ca75 expref: 18 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.940496:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ca7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936ca75 expref: 18 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.940506:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778953.940543:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+17:3649:x1877767663704960:12345-0@lo:103: Request processed in 78us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.940549:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790778953.940572:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663704960:0@lo:103: 00010000:00010000:2.0:1790778953.940589:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790778953.940595:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.940602:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce600 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778953.940611:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.940622:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778953.940628:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778953.940634:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778953.940648:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.940653:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778953.940666:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.940673:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936ca0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca13 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.940684:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778953.940686:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778953.940687:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778953.940904:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778953.940920:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663705088:0@lo:103: 00000100:00100000:1.0:1790778953.940950:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778953.941001:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663705088 00000100:00100000:1.0:1790778953.941005:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663705088 00010000:00010000:1.0:1790778953.941022:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936ca13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca0c expref: 17 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778953.941162:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790778953.941170:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+17:3652:x1877767663705088:12345-0@lo:103: 00010000:00010000:1.0:1790778953.941184:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778953.941189:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936ca13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca0c expref: 17 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.941198:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936ca13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936ca0c expref: 17 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.941213:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e7200/0xb1aa4014e936ca13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936ca0c expref: 17 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.941238:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778953.941268:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+16:3652:x1877767663705088:12345-0@lo:103: Request processed in 99us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778953.941274:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790778953.941304:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663705088:0@lo:103: 00010000:00010000:2.0:1790778953.941684:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778953.941687:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778953.941689:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778953.941788:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.941799:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790778953.941803:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.941812:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778953.941820:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778953.941825:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790778953.941942:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.941949:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778953.942035:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942043:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936ca36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca3d expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778953.942222:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663705216:0@lo:103: 00000100:00100000:2.0:1790778953.942263:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790778953.942304:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778953.942306:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778953.942307:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778953.942345:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663705216 00000100:00100000:3.0:1790778953.942357:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663705216 00010000:00010000:3.0:1790778953.942378:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e6600/0xb1aa4014e936ca3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca36 expref: 16 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.942435:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790778953.942443:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+16:3652:x1877767663705216:12345-0@lo:103: 00010000:00010000:3.0:1790778953.942544:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778953.942549:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e6600/0xb1aa4014e936ca3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca36 expref: 16 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942561:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e6600/0xb1aa4014e936ca3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936ca36 expref: 16 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942574:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6600/0xb1aa4014e936ca3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936ca36 expref: 16 pid: 6515 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942588:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942597:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942615:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942623:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942631:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942639:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942651:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742148a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790778953.942656:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942665:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942678:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.942689:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778953.942746:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+15:3652:x1877767663705216:12345-0@lo:103: Request processed in 303us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778953.942753:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1790778953.942824:0:10333:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.942832:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.942838:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7742148a00/0xb1aa4014e936cb78 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778953.943356:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663705216:0@lo:103: 00000100:00100000:2.0:1790778954.344232:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663705344:0@lo:41: 00000100:00100000:2.0:1790778954.344347:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778954.344575:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663705344 00000100:00100000:0.0:1790778954.344586:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663705344 00000100:00100000:0.0:1790778954.344651:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790778954.344662:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663705344:12345-0@lo:41: 00000004:00000024:0.0:1790778954.344763:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790778954.344855:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663705344:12345-0@lo:41: Request processed in 194us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778954.344863:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790778954.345242:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663705344:0@lo:41: 00010000:00010000:2.0:1790778954.665582:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778954.934038:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778954.934180:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778954.934342:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642682496 00000100:00100000:2.0:1790778954.934355:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642682496 00000100:00100000:2.0:1790778954.934462:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:2.0:1790778954.934476:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2399:x1877767642682496:12345-192.168.203.3@tcp:400: 00000100:00100000:2.0:1790778954.934581:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2399:x1877767642682496:12345-192.168.203.3@tcp:400: Request processed in 108us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778954.934590:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00080000:3.0:1790778954.935074:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778954.936067:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778954.936106:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778954.936144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778954.936216:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642682624 00000100:00100000:3.0:1790778954.936225:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642682624 00000100:00100000:3.0:1790778954.936299:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:3.0:1790778954.936310:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642682624:12345-192.168.203.3@tcp:400: 00000100:00100000:3.0:1790778954.936393:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642682624:12345-192.168.203.3@tcp:400: Request processed in 84us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778954.936400:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:0.0:1790778954.936479:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642682752 00000100:00100000:0.0:1790778954.936485:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642682752 00000100:00100000:0.0:1790778954.936526:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642682880 00000100:00100000:0.0:1790778954.936530:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642682880 00000100:00100000:0.0:1790778954.936557:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1790778954.936565:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642682752:12345-192.168.203.3@tcp:400: 00000100:00100000:0.0:1790778954.936596:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642682752:12345-192.168.203.3@tcp:400: Request processed in 33us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778954.936603:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1790778954.936616:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1790778954.936623:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642682880:12345-192.168.203.3@tcp:400: 00000100:00100000:0.0:1790778954.936650:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642682880:12345-192.168.203.3@tcp:400: Request processed in 27us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778954.936656:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00080000:2.0:1790778954.936927:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790778954.936933:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790778954.936936:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790778954.938069:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642682368 00000100:00100000:1.0:1790778954.938084:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642682368 00000100:00100000:1.0:1790778954.938151:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 199 00000100:00100000:1.0:1790778954.938162:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:2399:x1877767642682368:12345-192.168.203.3@tcp:400: 00000100:00100000:1.0:1790778954.938287:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:2399:x1877767642682368:12345-192.168.203.3@tcp:400: Request processed in 127us (4265us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778954.938297:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 199 10000000:01000000:1.0:1790778955.560016:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790778955.560026:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b760310d000 from 48 10000000:01000000:1.0:1790778955.560033:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790778955.560101:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.560116:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.560159:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.560191:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663705472:0@lo:101: 00000100:00100000:1.0:1790778955.560288:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.560373:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77201679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.560471:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663705472 00000100:00100000:2.0:1790778955.560482:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663705472 00000100:00100000:2.0:1790778955.560550:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790778955.560560:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+15:6520:x1877767663705472:12345-0@lo:101: 00010000:00010000:2.0:1790778955.560576:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778955.560593:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2200/0xb1aa4014e936cb86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cb7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.560636:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2200/0xb1aa4014e936cb86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cb7f expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.560657:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2200/0xb1aa4014e936cb86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cb7f expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.560667:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2200, rc 0) 00000100:00100000:2.0:1790778955.560734:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663705472:12345-0@lo:101: Request processed in 175us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.560742:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1790778955.561056:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663705472:0@lo:101: 00010000:00010000:0.0:1790778955.561075:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.561085:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.561176:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663705600:0@lo:501: 00000100:00100000:0.0:1790778955.561214:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.561251:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778955.561311:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663705600 00000100:00100000:1.0:1790778955.561316:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663705600 00000100:00100000:1.0:1790778955.561352:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1790778955.561360:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663705600:12345-0@lo:501: 00000100:00100000:1.0:1790778955.561513:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663705600:12345-0@lo:501: Request processed in 154us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.561520:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1790778955.561814:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663705600:0@lo:501: 00000100:00100000:0.0:1790778955.561848:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663705728:0@lo:503: 00000100:00100000:0.0:1790778955.561926:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.561955:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778955.562839:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663705728 00000100:00100000:1.0:1790778955.562850:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663705728 00000100:00100000:1.0:1790778955.562928:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790778955.562938:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663705728:12345-0@lo:503: 00000100:00100000:1.0:1790778955.563099:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663705728:12345-0@lo:503: Request processed in 161us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.563106:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1790778955.563231:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663705728:0@lo:503: 00000100:00100000:0.0:1790778955.565372:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10352:1877767663705856:0@lo:502: 00000100:00100000:0.0:1790778955.565471:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.565527:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc000 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.565589:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663705856 00000100:00100000:2.0:1790778955.565599:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663705856 00000100:00100000:2.0:1790778955.565653:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1790778955.565662:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:10352:x1877767663705856:12345-0@lo:502: 00000100:00100000:2.0:1790778955.565843:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+16:10352:x1877767663705856:12345-0@lo:502: Request processed in 181us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.565852:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1790778955.566206:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10352:1877767663705856:0@lo:502: 00000100:00100000:0.0:1790778955.566261:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10352:1877767663705984:0@lo:502: 00000100:00100000:0.0:1790778955.566299:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.566335:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc000 going to sleep for 11 seconds 00000100:00100000:1.0:1790778955.566401:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663705984 00000100:00100000:1.0:1790778955.566406:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663705984 00000100:00100000:1.0:1790778955.566448:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790778955.566457:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:10352:x1877767663705984:12345-0@lo:502: 00000100:00100000:1.0:1790778955.566547:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:10352:x1877767663705984:12345-0@lo:502: Request processed in 90us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.566563:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1790778955.567306:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10352:1877767663705984:0@lo:502: 00000040:00080000:0.0:1790778955.567339:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790778955.567552:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1790778955.567576:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790778955.567589:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.567611:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778955.567636:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1790778955.567639:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1790778955.567642:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790778955.567678:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.567688:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.567698:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.567726:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663706112:0@lo:101: 00000100:00100000:3.0:1790778955.567778:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.567822:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771190f300 going to sleep for 11 seconds 00000100:00100000:1.0:1790778955.567946:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663706112 00000100:00100000:1.0:1790778955.567954:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663706112 00000100:00100000:1.0:1790778955.567999:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790778955.568009:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+16:6520:x1877767663706112:12345-0@lo:101: 00010000:00010000:1.0:1790778955.568022:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778955.568038:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77055cfa00/0xb1aa4014e936cb94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cb8d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.568068:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cfa00/0xb1aa4014e936cb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cb8d expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.568079:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77055cfa00/0xb1aa4014e936cb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cb8d expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.568088:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cfa00, rc 0) 00000100:00100000:1.0:1790778955.568141:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663706112:12345-0@lo:101: Request processed in 132us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.568147:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1790778955.568501:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663706112:0@lo:101: 00010000:00010000:0.0:1790778955.568519:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.568529:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.568607:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663706240:0@lo:501: 00000100:00100000:0.0:1790778955.568641:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.568668:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc000 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.569150:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663706240 00000100:00100000:2.0:1790778955.569156:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663706240 00000100:00100000:2.0:1790778955.569189:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790778955.569197:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663706240:12345-0@lo:501: 00000100:00100000:2.0:1790778955.571040:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663706240:12345-0@lo:501: Request processed in 1832us (2386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.571055:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1790778955.574078:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663706240:0@lo:501: 00000100:00100000:0.0:1790778955.574178:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663706368:0@lo:503: 00000100:00100000:0.0:1790778955.574291:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.574381:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc000 going to sleep for 11 seconds 00000100:00100000:3.0:1790778955.574633:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663706368 00000100:00100000:3.0:1790778955.574643:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663706368 00000100:00100000:2.0:1790778955.574921:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1790778955.574935:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663706368:12345-0@lo:503: 00000100:00100000:2.0:1790778955.575106:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663706368:12345-0@lo:503: Request processed in 174us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.575121:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1790778955.575390:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663706368:0@lo:503: 00000100:00100000:0.0:1790778955.577290:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10353:1877767663706496:0@lo:502: 00000100:00100000:0.0:1790778955.577384:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.577443:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790778955.577512:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663706496 00000100:00100000:1.0:1790778955.577531:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663706496 00000100:00100000:1.0:1790778955.577594:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1790778955.577612:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:10353:x1877767663706496:12345-0@lo:502: 00000100:00100000:1.0:1790778955.577786:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+17:10353:x1877767663706496:12345-0@lo:502: Request processed in 174us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.577794:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790778955.578118:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10353:1877767663706496:0@lo:502: 00000020:01000000:0.0:1790778955.578167:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778955.578179:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778955.578182:0:10353:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790778955.578189:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790778955.578215:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10353:1877767663706624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778955.578257:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.578295:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.578358:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663706624 00000100:00100000:2.0:1790778955.578363:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663706624 00000100:00100000:2.0:1790778955.578404:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1790778955.578413:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:10353:x1877767663706624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778955.578507:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:10353:x1877767663706624:12345-0@lo:502:llog_process_th.0 Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.578514:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1790778955.578690:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10353:1877767663706624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790778955.578727:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778955.578733:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778955.578735:0:10353:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790778955.578739:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1790778955.579013:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1790778955.579039:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790778955.579051:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.579064:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778955.579075:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790778955.579078:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b77344a6000 from 48 10000000:01000000:2.0:1790778955.579082:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790778955.579114:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.579123:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.579143:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778955.579160:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663706752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.579205:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778955.579231:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.579246:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663706752 00000100:00100000:2.0:1790778955.579250:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663706752 00000100:00100000:2.0:1790778955.579274:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1790778955.579281:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+17:6520:x1877767663706752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778955.579292:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778955.579307:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2600/0xb1aa4014e936cba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cb9b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.579332:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2600/0xb1aa4014e936cba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cb9b expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.579344:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2600/0xb1aa4014e936cba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cb9b expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.579353:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2600, rc 0) 00000100:00100000:2.0:1790778955.579384:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663706752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.579391:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1790778955.579423:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663706752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778955.579437:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.579447:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778955.579516:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663706880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.579559:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778955.579572:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.579582:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663706880 00000100:00100000:2.0:1790778955.579585:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663706880 00000100:00100000:2.0:1790778955.579665:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1790778955.579672:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663706880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.579990:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663706880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.579997:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1790778955.580027:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663706880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.580056:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663707008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.580099:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778955.580112:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.580133:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663707008 00000100:00100000:2.0:1790778955.580138:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663707008 00000100:00100000:2.0:1790778955.580156:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1790778955.580162:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663707008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.580257:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663707008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778955.580267:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663707008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.580268:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1790778955.587349:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10354:1877767663707136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778955.587484:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.587589:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa5240 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.590400:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663707136 00000100:00100000:2.0:1790778955.590421:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663707136 00000100:00100000:2.0:1790778955.590906:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1790778955.590922:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:10354:x1877767663707136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778955.591167:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+18:10354:x1877767663707136:12345-0@lo:502:llog_process_th.0 Request processed in 249us (3683us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.591183:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1790778955.591952:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10354:1877767663707136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778955.592062:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10354:1877767663707264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778955.592121:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.592185:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.592690:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663707264 00000100:00100000:2.0:1790778955.592699:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663707264 00000100:00100000:2.0:1790778955.592811:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1790778955.592822:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:10354:x1877767663707264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778955.593004:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:10354:x1877767663707264:12345-0@lo:502:llog_process_th.0 Request processed in 183us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.593012:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1790778955.593109:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10354:1877767663707264:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790778955.593150:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790778955.595587:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1790778955.595644:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790778955.595660:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.595675:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778955.595687:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790778955.595691:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1790778955.595694:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790778955.595751:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.595778:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.595791:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.595820:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663707392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.596082:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.596151:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771190f300 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.596298:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663707392 00000100:00100000:2.0:1790778955.596309:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663707392 00000100:00100000:2.0:1790778955.596472:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1790778955.596484:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+18:6520:x1877767663707392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778955.596502:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778955.596518:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a3000/0xb1aa4014e936cbb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cba9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.596547:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3000/0xb1aa4014e936cbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cba9 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.596560:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a3000/0xb1aa4014e936cbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cba9 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.596570:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3000, rc 0) 00000100:00100000:2.0:1790778955.596640:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663707392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.596648:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1790778955.596772:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663707392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778955.596790:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.596798:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.596871:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663707520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778955.596921:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.601192:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663707520 00000100:00100000:0.0:1790778955.601211:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663707520 00000100:00100000:1.0:1790778955.601233:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778955.601293:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1790778955.601306:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663707520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778955.601575:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663707520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (4652us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778955.601584:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1790778955.601910:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663707520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778955.601977:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663707648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778955.602036:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.602068:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778955.602114:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663707648 00000100:00100000:0.0:1790778955.602120:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663707648 00000100:00100000:0.0:1790778955.602161:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1790778955.602172:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663707648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778955.602365:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663707648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778955.602373:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1790778955.602459:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663707648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778955.607267:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10355:1877767663707776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778955.607394:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.607820:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.607918:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663707776 00000100:00100000:2.0:1790778955.607937:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663707776 00000100:00100000:2.0:1790778955.608057:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1790778955.608069:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+19:10355:x1877767663707776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778955.608262:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+19:10355:x1877767663707776:12345-0@lo:502:llog_process_th.0 Request processed in 195us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.608272:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1790778955.608377:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10355:1877767663707776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790778955.608414:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778955.608427:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778955.608430:0:10355:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790778955.608437:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790778955.608466:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10355:1877767663707904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778955.608519:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.608713:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790778955.608792:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663707904 00000100:00100000:3.0:1790778955.608798:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663707904 00000100:00100000:3.0:1790778955.608830:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790778955.608838:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+19:10355:x1877767663707904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778955.608969:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+19:10355:x1877767663707904:12345-0@lo:502:llog_process_th.0 Request processed in 132us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.608976:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1790778955.609069:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10355:1877767663707904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790778955.609089:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778955.609094:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778955.609097:0:10355:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790778955.609101:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1790778955.609606:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1790778955.609633:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790778955.609645:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.609659:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778955.609671:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790778955.609674:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b7712708000 from 48 10000000:01000000:3.0:1790778955.609678:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790778955.609722:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.609732:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.609743:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.609764:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.609809:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.610139:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.610420:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663708032 00000100:00100000:2.0:1790778955.610430:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663708032 00000100:00100000:2.0:1790778955.610491:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790778955.610666:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+19:6520:x1877767663708032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778955.610759:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778955.610853:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936cbbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cbb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.610909:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936cbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cbb7 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.610923:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936cbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cbb7 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.610934:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2a00, rc 0) 00000100:00100000:2.0:1790778955.611004:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663708032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 342us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.611081:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778955.611101:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.611110:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.611202:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.611233:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.611293:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778955.612308:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663708160 00000100:00100000:0.0:1790778955.612320:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663708160 00000100:00100000:2.0:1790778955.612399:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1790778955.612443:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1790778955.612453:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663708160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778955.613288:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663708160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 833us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778955.613297:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1790778955.613827:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.614025:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.614090:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.614173:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778955.614275:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663708288 00000100:00100000:1.0:1790778955.614290:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663708288 00000100:00100000:1.0:1790778955.614347:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790778955.614357:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663708288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778955.614521:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663708288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.614528:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1790778955.614670:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778955.615582:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10356:1877767663708416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778955.615651:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.615751:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa5240 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.626383:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663708416 00000100:00100000:2.0:1790778955.626404:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663708416 00000100:00100000:2.0:1790778955.626597:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1790778955.626610:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:10356:x1877767663708416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778955.626864:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:10356:x1877767663708416:12345-0@lo:502:llog_process_th.0 Request processed in 256us (11211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.626873:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1790778955.627187:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10356:1877767663708416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778955.627298:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10356:1877767663708544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778955.627355:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.627564:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790778955.627676:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663708544 00000100:00100000:1.0:1790778955.627683:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663708544 00000100:00100000:1.0:1790778955.627720:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1790778955.627729:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:10356:x1877767663708544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778955.627839:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:10356:x1877767663708544:12345-0@lo:502:llog_process_th.0 Request processed in 110us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.627847:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1790778955.628053:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10356:1877767663708544:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790778955.628080:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1790778955.628282:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1790778955.628306:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790778955.628318:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.628331:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778955.628343:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1790778955.628346:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1790778955.628350:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790778955.628383:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.628400:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.628411:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.628432:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790778955.628549:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.628587:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778955.628632:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663708672 00000100:00100000:0.0:1790778955.628637:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663708672 00000100:00100000:0.0:1790778955.628669:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790778955.628676:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663708672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778955.628689:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778955.628705:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768200/0xb1aa4014e936cbcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cbc5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.628733:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768200/0xb1aa4014e936cbcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cbc5 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.628745:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768200/0xb1aa4014e936cbcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cbc5 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.628766:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768200, rc 0) 00000100:00100000:0.0:1790778955.628814:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663708672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778955.628821:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1790778955.629017:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778955.629033:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.629043:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.629103:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778955.629142:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.629169:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778955.629209:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663708800 00000100:00100000:0.0:1790778955.629213:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663708800 00000100:00100000:0.0:1790778955.629235:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790778955.629241:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663708800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778955.629377:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663708800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778955.629385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1790778955.629447:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778955.629600:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778955.629648:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.629672:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f480 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.629729:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663708928 00000100:00100000:2.0:1790778955.629735:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663708928 00000100:00100000:2.0:1790778955.629761:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790778955.629767:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663708928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.629868:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663708928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.629876:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1790778955.630056:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663708928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778955.630830:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10357:1877767663709056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778955.630962:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.631043:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.631081:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663709056 00000100:00100000:2.0:1790778955.631088:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663709056 00000100:00100000:2.0:1790778955.631165:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1790778955.631175:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:10357:x1877767663709056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778955.631327:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:10357:x1877767663709056:12345-0@lo:502:llog_process_th.0 Request processed in 152us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.631334:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790778955.631428:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10357:1877767663709056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790778955.631466:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778955.631489:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778955.631492:0:10357:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790778955.631498:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790778955.631527:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10357:1877767663709184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778955.631565:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.632089:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778955.632210:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663709184 00000100:00100000:0.0:1790778955.632218:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663709184 00000100:00100000:0.0:1790778955.632259:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1790778955.632268:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:10357:x1877767663709184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778955.632407:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:10357:x1877767663709184:12345-0@lo:502:llog_process_th.0 Request processed in 139us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778955.632415:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1790778955.632618:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10357:1877767663709184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790778955.632650:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778955.632658:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778955.632661:0:10357:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790778955.632665:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1790778955.633574:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1790778955.633606:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1790778955.633620:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.633651:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778955.633666:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790778955.633669:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b77208a9000 from 48 10000000:01000000:0.0:1790778955.633673:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790778955.633715:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.633724:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.633736:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.633761:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663709312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790778955.633819:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.633936:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc300 going to sleep for 11 seconds 00000100:00100000:1.0:1790778955.634031:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663709312 00000100:00100000:1.0:1790778955.634039:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663709312 00000100:00100000:1.0:1790778955.634142:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1790778955.634153:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663709312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778955.634168:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778955.634184:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77055cf800/0xb1aa4014e936cbda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cbd3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.634213:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cf800/0xb1aa4014e936cbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cbd3 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.634226:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77055cf800/0xb1aa4014e936cbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cbd3 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.634237:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cf800, rc 0) 00000100:00100000:1.0:1790778955.634291:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663709312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.634307:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790778955.634377:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663709312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778955.634392:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.634401:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.634739:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663709440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778955.634776:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.634811:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778955.634875:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663709440 00000100:00100000:3.0:1790778955.634909:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663709440 00000100:00100000:3.0:1790778955.634943:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790778955.634951:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663709440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.635099:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663709440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.635106:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1790778955.635207:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663709440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778955.635239:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663709568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778955.635282:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778955.635302:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778955.635352:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663709568 00000100:00100000:3.0:1790778955.635357:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663709568 00000100:00100000:3.0:1790778955.635373:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1790778955.635379:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663709568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.635612:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663709568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.635620:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1790778955.635731:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663709568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.636604:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10358:1877767663709696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778955.636676:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778955.636750:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773438a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790778955.636790:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663709696 00000100:00100000:0.0:1790778955.636797:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663709696 00000100:00100000:0.0:1790778955.636921:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1790778955.636931:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+22:10358:x1877767663709696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778955.637072:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+22:10358:x1877767663709696:12345-0@lo:502:llog_process_th.0 Request processed in 142us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778955.637080:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1790778955.637191:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10358:1877767663709696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778955.637242:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10358:1877767663709824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778955.637280:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778955.638167:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773438a540 going to sleep for 11 seconds 00000100:00100000:3.0:1790778955.638234:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663709824 00000100:00100000:3.0:1790778955.638241:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663709824 00000100:00100000:3.0:1790778955.638415:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790778955.638426:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:10358:x1877767663709824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778955.638593:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:10358:x1877767663709824:12345-0@lo:502:llog_process_th.0 Request processed in 169us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.638602:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1790778955.638765:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10358:1877767663709824:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790778955.638809:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790778955.639034:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1790778955.639059:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790778955.639072:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.639097:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778955.639109:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790778955.639112:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1790778955.639116:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790778955.639163:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.639173:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.639183:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.639206:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663709952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.639252:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.639330:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778955.639439:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663709952 00000100:00100000:0.0:1790778955.639447:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663709952 00000100:00100000:1.0:1790778955.639692:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790778955.639707:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663709952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778955.639722:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778955.639737:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77055cec00/0xb1aa4014e936cbe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cbe1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.639764:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cec00/0xb1aa4014e936cbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cbe1 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.639775:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77055cec00/0xb1aa4014e936cbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cbe1 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.639785:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cec00, rc 0) 00000100:00100000:1.0:1790778955.639840:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663709952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.639847:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790778955.639919:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663709952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778955.639934:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.639944:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.640009:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663710080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.640035:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.640427:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.640558:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663710080 00000100:00100000:2.0:1790778955.640565:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663710080 00000100:00100000:2.0:1790778955.640597:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1790778955.640605:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663710080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.640806:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663710080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.640814:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790778955.640874:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663710080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.640944:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663710208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.640995:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.641012:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.642768:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663710208 00000100:00100000:2.0:1790778955.642787:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663710208 00000100:00100000:2.0:1790778955.642847:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1790778955.642857:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663710208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.643085:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663710208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.643093:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790778955.643429:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663710208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.644047:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10359:1877767663710336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778955.644119:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.644507:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1790778955.644652:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663710336 00000100:00100000:0.0:1790778955.644662:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663710336 00000100:00100000:1.0:1790778955.644811:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1790778955.644828:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:10359:x1877767663710336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778955.644996:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:10359:x1877767663710336:12345-0@lo:502:llog_process_th.0 Request processed in 173us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.645003:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1790778955.645109:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10359:1877767663710336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790778955.645150:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790778955.645161:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778955.645164:0:10359:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790778955.645171:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790778955.645199:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10359:1877767663710464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778955.645239:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.647171:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8780 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.647249:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663710464 00000100:00100000:2.0:1790778955.647262:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663710464 00000100:00100000:3.0:1790778955.647713:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1790778955.647724:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:10359:x1877767663710464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778955.648572:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:10359:x1877767663710464:12345-0@lo:502:llog_process_th.0 Request processed in 842us (3325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.648585:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1790778955.648774:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10359:1877767663710464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790778955.648820:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778955.648832:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778955.648835:0:10359:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790778955.648840:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1790778955.656002:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1790778955.656057:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790778955.656074:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.656115:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778955.656139:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790778955.656142:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b773059cd40 from 1 10000000:01000000:3.0:1790778955.656146:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790778955.656204:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936cbef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.656214:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936cbef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.656226:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936cbef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.656257:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663710592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.656344:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.656414:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.656503:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663710592 00000100:00100000:2.0:1790778955.656513:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663710592 00000100:00100000:2.0:1790778955.656583:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1790778955.656593:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663710592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778955.656611:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778955.656640:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936cbf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cbef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.656670:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936cbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cbef expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.656681:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936cbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cbef expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.656691:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2800, rc 0) 00000100:00100000:2.0:1790778955.656745:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663710592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.656752:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1790778955.656865:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663710592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778955.656906:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936cbef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.656917:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936cbef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cbf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.656990:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663710720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778955.657018:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778955.657046:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.657133:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663710720 00000100:00100000:2.0:1790778955.657138:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663710720 00000100:00100000:2.0:1790778955.657171:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790778955.657180:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663710720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778955.657268:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663710720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (248us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790778955.657275:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1790778955.657459:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663710720:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1790778955.657491:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790778955.657499:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936cbef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.657508:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936cbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.690284:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778955.880290:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778955.880328:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663710848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778955.880429:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.880986:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663710848 00000100:00100000:1.0:1790778955.881000:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663710848 00000100:00100000:1.0:1790778955.881099:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790778955.881115:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663710848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778955.881193:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778955.881266:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663710848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.881274:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1790778955.881389:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790778955.881438:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603966a00 x1877767663710848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778955.881462:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663710848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778955.881793:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778955.881807:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663710976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790778955.881857:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778955.882846:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663710976 00000100:00100000:2.0:1790778955.882858:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663710976 00000100:00100000:2.0:1790778955.882966:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790778955.882977:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663710976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790778955.883003:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778955.883083:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663710976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.883108:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1790778955.883202:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790778955.883456:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c50380 x1877767663710976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778955.883479:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663710976:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790778956.712221:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778956.905208:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663711104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790778956.905310:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778956.905394:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663711616:0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.905423:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778956.905442:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663712128:0@lo:400:kworker.0 00000100:00100000:1.0:1790778956.905462:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663711488:0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.905481:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778956.905504:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663712640:0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.905527:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778956.905574:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663711616 00000100:00100000:0.0:1790778956.905583:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663711232:0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.905585:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663711616 00000100:00100000:0.0:1790778956.905629:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778956.905639:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790778956.905649:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663711616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.905715:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663711616:12345-0@lo:400:kworker.0 Request processed in 67us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.905723:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790778956.905749:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663712128 00000100:00100000:3.0:1790778956.905754:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663712128 00000100:00100000:3.0:1790778956.905802:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663712640 00000100:00100000:3.0:1790778956.905806:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663712640 00000100:00100000:3.0:1790778956.905849:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790778956.905856:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663712128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.905915:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663712128:12345-0@lo:400:kworker.0 Request processed in 60us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.905922:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790778956.905934:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790778956.905940:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663712640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.905969:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663712640:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.905975:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790778956.906010:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663711360:0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.906037:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778956.906057:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663711872:0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.906077:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778956.906092:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663712384:0@lo:400:kworker.0 00000100:00080000:2.0:1790778956.906258:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790778956.906295:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a9f80 x1877767663712640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778956.906311:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663712640:0@lo:400:kworker.0 00000100:00100000:2.0:1790778956.906324:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663711616:0@lo:400:kworker.0 00010000:00080000:2.0:1790778956.906333:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603964000 x1877767663712128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778956.906347:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663712128:0@lo:400:kworker.0 00000100:00100000:2.0:1790778956.906383:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663711104 00000100:00100000:2.0:1790778956.906387:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663711104 00000100:00100000:2.0:1790778956.906511:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790778956.906522:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663711104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790778956.906551:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790778956.906600:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778956.906626:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778956.906632:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663712768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778956.906658:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778956.906681:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663711360 00000100:00100000:3.0:1790778956.906685:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663711360 00000100:00100000:3.0:1790778956.906703:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663711872 00000100:00100000:3.0:1790778956.906706:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663711872 00000100:00100000:3.0:1790778956.906718:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663712384 00000100:00100000:3.0:1790778956.906721:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663712384 00000100:00100000:3.0:1790778956.906747:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790778956.906753:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663711360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.906791:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663711360:12345-0@lo:400:kworker.0 Request processed in 38us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.906798:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790778956.906810:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790778956.906816:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663711872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.906841:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663711872:12345-0@lo:400:kworker.0 Request processed in 25us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.906847:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790778956.906857:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790778956.906863:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663712384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.906911:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663712384:12345-0@lo:400:kworker.0 Request processed in 48us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.906917:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790778956.906947:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663711360:0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.906957:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663711872:0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.906966:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663712384:0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.906987:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663711232 00000100:00100000:3.0:1790778956.906991:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663711232 00000100:00100000:3.0:1790778956.907019:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790778956.907025:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663711232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.907056:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663711232:12345-0@lo:400:kworker.0 Request processed in 32us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.907072:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790778956.907113:0:8441:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1790778956.907132:0:8441:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:3.0:1790778956.907147:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790778956.907150:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778956.907313:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663712768 00000100:00100000:3.0:1790778956.907317:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663712768 00000100:00100000:3.0:1790778956.907405:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790778956.907412:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663712768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778956.907424:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790778956.907469:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663712768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.907476:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1790778956.907500:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c52300 x1877767663712768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778956.907516:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663712768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778956.907806:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663711232:0@lo:400:kworker.0 00000100:00100000:0.0:1790778956.907816:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663711744:0@lo:400:kworker.0 00000100:00100000:0.0:1790778956.907850:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778956.907895:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663712256:0@lo:400:kworker.0 00000100:00100000:0.0:1790778956.907919:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778956.907956:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663712256 00000100:00100000:0.0:1790778956.907961:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663712256 00000100:00100000:0.0:1790778956.907990:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790778956.907997:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663712256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778956.908035:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663712256:12345-0@lo:400:kworker.0 Request processed in 38us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778956.908041:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1790778956.908071:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603964e00 x1877767663712256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778956.908082:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663712256:0@lo:400:kworker.0 00000100:00100000:1.0:1790778956.909178:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778956.909219:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663712000:0@lo:400:kworker.0 00000100:00100000:1.0:1790778956.909258:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778956.909283:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663712512:0@lo:400:kworker.0 00000100:00100000:1.0:1790778956.909305:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778956.909354:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663712000 00000100:00100000:1.0:1790778956.909361:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663712000 00000100:00100000:1.0:1790778956.909657:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663712512 00000100:00100000:1.0:1790778956.909663:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663712512 00000100:00100000:1.0:1790778956.909687:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790778956.909696:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663712000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778956.909766:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663712000:12345-0@lo:400:kworker.0 Request processed in 70us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778956.909774:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790778956.909792:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790778956.909799:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663712512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778956.909825:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663712512:12345-0@lo:400:kworker.0 Request processed in 28us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778956.909847:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1790778956.909869:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790778956.909947:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663711744 00000100:00100000:3.0:1790778956.909953:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663711744 00000100:00100000:3.0:1790778956.909976:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663711488 00000100:00100000:3.0:1790778956.909979:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663711488 00000100:00100000:3.0:1790778956.909994:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790778956.910000:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663711744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.910050:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663711744:12345-0@lo:400:kworker.0 Request processed in 50us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.910056:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790778956.910069:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790778956.910075:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663711488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778956.910126:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663711488:12345-0@lo:400:kworker.0 Request processed in 41us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.910133:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790778956.910712:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663711104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4189us (5399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778956.910723:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1790778956.911014:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603910380 x1877767663711104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778956.911044:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663711104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790778956.911076:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663711488:0@lo:400:kworker.0 00010000:00080000:1.0:1790778956.911093:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603965180 x1877767663712000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778956.911102:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663712000:0@lo:400:kworker.0 00010000:00080000:1.0:1790778956.911114:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a8700 x1877767663712512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778956.911134:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663712512:0@lo:400:kworker.0 00000100:00100000:0.0:1790778956.914133:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663711744:0@lo:400:kworker.0 00000100:00100000:1.0:1790778957.419540:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790778957.419575:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663712896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790778957.419673:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778957.419925:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663712896 00000100:00100000:3.0:1790778957.419937:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663712896 00000100:00100000:3.0:1790778957.420002:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790778957.420012:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663712896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790778957.420058:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790778957.420136:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663712896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.420145:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790778957.420349:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663712896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790778957.554990:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778957.555353:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642683008 00000100:00100000:0.0:1790778957.555369:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642683008 00000100:00100000:0.0:1790778957.555449:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:0.0:1790778957.555460:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:6170:x1877767642683008:12345-192.168.203.3@tcp:101: 00010000:00010000:0.0:1790778957.555505:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778957.555530:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936cbfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b4256ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.555570:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936cbfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256ae expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.555584:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936cbfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256ae expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.555596:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768c00, rc 0) 00000100:00100000:0.0:1790778957.555686:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6170:x1877767642683008:12345-192.168.203.3@tcp:101: Request processed in 228us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.555694:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:2.0:1790778957.564938:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778957.566087:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642683136 00000100:00100000:3.0:1790778957.566103:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642683136 00000100:00100000:3.0:1790778957.566188:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00100000:3.0:1790778957.566199:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6170:x1877767642683136:12345-192.168.203.3@tcp:501: 00000100:00100000:3.0:1790778957.566401:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6170:x1877767642683136:12345-192.168.203.3@tcp:501: Request processed in 203us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.566409:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00100000:1.0:1790778957.572644:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778957.572824:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642683264 00000100:00100000:3.0:1790778957.572839:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642683264 00000100:00100000:3.0:1790778957.572945:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 245 00000100:00100000:3.0:1790778957.572957:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6170:x1877767642683264:12345-192.168.203.3@tcp:503: 00000100:00100000:3.0:1790778957.573400:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6170:x1877767642683264:12345-192.168.203.3@tcp:503: Request processed in 444us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.573410:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 245 00000100:00100000:1.0:1790778957.588122:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778957.588647:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642683392 00000100:00100000:0.0:1790778957.588660:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642683392 00000100:00100000:0.0:1790778957.588744:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 246 00000100:00100000:0.0:1790778957.588754:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6663:x1877767642683392:12345-192.168.203.3@tcp:502: 00000100:00100000:0.0:1790778957.589336:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6663:x1877767642683392:12345-192.168.203.3@tcp:502: Request processed in 578us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.589346:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 246 00000100:00100000:2.0:1790778957.592955:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778957.593324:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642683520 00000100:00100000:3.0:1790778957.593338:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642683520 00000100:00100000:3.0:1790778957.593412:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 247 00000100:00100000:3.0:1790778957.593423:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6663:x1877767642683520:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790778957.593632:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6663:x1877767642683520:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 210us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.593641:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 247 00000100:00100000:1.0:1790778957.598583:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778957.598926:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642683648 00000100:00100000:0.0:1790778957.598941:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642683648 00000100:00100000:0.0:1790778957.599011:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 248 00000100:00100000:0.0:1790778957.599023:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6170:x1877767642683648:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778957.599059:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778957.599096:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768e00/0xb1aa4014e936cc04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b4256b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.599166:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768e00/0xb1aa4014e936cc04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256b5 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.599180:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768e00/0xb1aa4014e936cc04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256b5 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.599190:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768e00, rc 0) 00000100:00100000:0.0:1790778957.599276:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6170:x1877767642683648:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 255us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.599285:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 248 00000100:00100000:1.0:1790778957.608161:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778957.608389:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642683776 00000100:00100000:2.0:1790778957.608402:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642683776 00000100:00100000:2.0:1790778957.608471:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 249 00000100:00100000:2.0:1790778957.608482:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6170:x1877767642683776:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778957.608811:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6170:x1877767642683776:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 329us (664us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790778957.608821:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 249 00010000:00010000:3.0:1790778957.738700:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778958.761100:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790778959.201538:0:10397:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8c14e8a0 20000000:00000080:2.0:1790778959.201562:0:10397:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b7603977000 uarg=0000000000000000 20000000:01000000:2.0:1790778959.201737:0:10397:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790778959.201745:0:10397:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790778959.201819:0:10397:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790778959.202566:0:10398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1790778959.202843:0:10397:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1790778959.208512:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1790778959.208574:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1790778959.208590:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1790778959.208611:0:10397:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790778959.208637:0:10397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.208667:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936c8a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c8a0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.208677:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b770894b800/0xb1aa4014e936c8b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c8ae expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.208684:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b770894be00/0xb1aa4014e936c909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936c902 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.208690:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ca2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ca28 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.208702:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936cb47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425676 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.208729:0:10397:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.208780:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936cb47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425676 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.208796:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936cb47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425676 expref: 9 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778959.208814:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1877767663713024:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790778959.208973:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ca2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936ca28 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.208982:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ca2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936ca28 expref: 23 pid: 6517 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778959.208991:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1877767663713152:0@lo:104: 00000100:00100000:2.0:1790778959.209039:0:10397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778959.209112:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663713152 00000100:00100000:2.0:1790778959.209123:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663713152 00000100:00100000:2.0:1790778959.209181:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790778959.209191:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:10397:x1877767663713152:12345-0@lo:104: 00010000:00010000:2.0:1790778959.209205:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209287:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790778959.209295:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:10397:x1877767663713152:12345-0@lo:104: Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778959.209311:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1790778959.209339:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790778959.209346:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209354:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e6400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778959.209359:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209368:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778959.209376:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778959.209382:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790778959.209411:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209418:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778959.209441:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209448:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ca28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ca2f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209463:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778959.209464:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778959.209466:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778959.209488:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b770894be00/0xb1aa4014e936c909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c902 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209503:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b770894be00/0xb1aa4014e936c909 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c902 expref: 23 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778959.209513:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1877767663713408:0@lo:104: 00000100:00100000:2.0:1790778959.209542:0:10397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778959.209573:0:6507:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790778959.209584:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663713408 00000100:00100000:2.0:1790778959.209587:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663713408 00000100:00100000:2.0:1790778959.209605:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790778959.209612:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:10397:x1877767663713408:12345-0@lo:104: 00010000:00010000:2.0:1790778959.209620:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209652:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790778959.209657:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:10397:x1877767663713408:12345-0@lo:104: Request processed in 46us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778959.209663:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1790778959.209711:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b770894b800/0xb1aa4014e936c8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c8ae expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209720:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b770894b800/0xb1aa4014e936c8b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c8ae expref: 23 pid: 6517 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778959.209730:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603965180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1877767663713536:0@lo:104: 00000100:00100000:2.0:1790778959.209754:0:10397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778959.209774:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663713536 00000100:00100000:2.0:1790778959.209778:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663713536 00000100:00100000:2.0:1790778959.209794:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790778959.209805:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603966d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:10397:x1877767663713536:12345-0@lo:104: 00010000:00010000:2.0:1790778959.209813:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209845:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790778959.209850:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603966d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:10397:x1877767663713536:12345-0@lo:104: Request processed in 45us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778959.209856:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1790778959.209872:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790778959.209906:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209914:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663600 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778959.209917:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209926:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778959.209932:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778959.209937:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790778959.209953:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209958:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778959.209966:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209984:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7701663600/0xb1aa4014e936c902 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c909 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.209996:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790778959.209999:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210005:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ba00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778959.210008:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210015:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778959.210022:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778959.210027:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790778959.210041:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210047:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778959.210065:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210072:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936c8ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210081:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778959.210089:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778959.210091:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778959.210124:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936c8a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936c8a0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210133:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936c8a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936c8a0 expref: 23 pid: 6515 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778959.210141:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1877767663713920:0@lo:104: 00000100:00100000:2.0:1790778959.210167:0:10397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778959.210187:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663713920 00000100:00100000:2.0:1790778959.210190:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663713920 00000100:00100000:2.0:1790778959.210210:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790778959.210216:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603967b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:10397:x1877767663713920:12345-0@lo:104: 00010000:00010000:2.0:1790778959.210224:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7701663200/0xb1aa4014e936c8a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210257:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790778959.210262:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603967b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:10397:x1877767663713920:12345-0@lo:104: Request processed in 47us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778959.210268:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1790778959.210281:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790778959.210285:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7701663200/0xb1aa4014e936c8a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210291:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790778959.210294:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663200/0xb1aa4014e936c8a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210301:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7701663200/0xb1aa4014e936c8a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778959.210315:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663200/0xb1aa4014e936c8a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778959.210320:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790778959.210335:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7701663200/0xb1aa4014e936c8a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210340:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778959.210347:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7701663200/0xb1aa4014e936c8a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210354:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7701663200/0xb1aa4014e936c8a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936c8a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778959.210369:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778959.210370:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778959.210372:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778959.210383:0:10397:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f2480 going to sleep for 11 seconds 00000100:00100000:2.0:1790778959.210408:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1877767663713152:0@lo:104: 00000100:00100000:2.0:1790778959.210416:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1877767663713408:0@lo:104: 00000100:00100000:2.0:1790778959.210422:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603965180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1877767663713536:0@lo:104: 00000100:00100000:2.0:1790778959.210428:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1877767663713920:0@lo:104: 00000100:00100000:3.0:1790778959.211241:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663713664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790778959.211305:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778959.211355:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790778959.211362:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663713280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790778959.211383:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790778959.211406:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778959.211977:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663714048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778959.212014:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778959.212043:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790778959.212051:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663713792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778959.212109:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778959.212143:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663713664 00000100:00100000:0.0:1790778959.212150:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663713664 00010000:00010000:0.0:1790778959.212185:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b770894be00/0xb1aa4014e936c909 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c902 expref: 24 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778959.212210:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663713280 00000100:00100000:0.0:1790778959.212214:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663713280 00010000:00010000:0.0:1790778959.212227:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ca2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca28 expref: 25 pid: 6517 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778959.212237:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663714048 00000100:00100000:0.0:1790778959.212240:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663714048 00010000:00010000:0.0:1790778959.212276:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936c8a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c8a0 expref: 26 pid: 6515 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778959.212288:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663713792 00000100:00100000:0.0:1790778959.212291:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663713792 00010000:00010000:0.0:1790778959.212302:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b770894b800/0xb1aa4014e936c8b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c8ae expref: 27 pid: 6517 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778959.212316:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790778959.212325:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+27:3652:x1877767663713664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790778959.212340:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778959.212345:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b770894be00/0xb1aa4014e936c909 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c902 expref: 27 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212355:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b770894be00/0xb1aa4014e936c909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c902 expref: 27 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212372:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894be00/0xb1aa4014e936c909 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c902 expref: 27 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212389:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778959.212430:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+26:3652:x1877767663713664:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778959.212437:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790778959.212455:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790778959.212462:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+25:3652:x1877767663713280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790778959.212483:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778959.212488:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ca2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ca28 expref: 25 pid: 6517 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212507:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ca2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936ca28 expref: 25 pid: 6517 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212518:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ca2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936ca28 expref: 25 pid: 6517 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212526:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778959.212551:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663713280:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778959.212557:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790778959.212569:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790778959.212575:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+23:3650:x1877767663714048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790778959.212583:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778959.212587:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936c8a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c8a0 expref: 23 pid: 6515 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212595:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936c8a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c8a0 expref: 23 pid: 6515 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212605:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936c8a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c8a0 expref: 23 pid: 6515 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212614:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778959.212642:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+22:3650:x1877767663714048:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778959.212793:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790778959.212809:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790778959.212815:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+21:3650:x1877767663713792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790778959.212846:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778959.212852:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b770894b800/0xb1aa4014e936c8b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936c8ae expref: 21 pid: 6517 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212860:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b770894b800/0xb1aa4014e936c8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936c8ae expref: 21 pid: 6517 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212870:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894b800/0xb1aa4014e936c8b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936c8ae expref: 21 pid: 6517 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.212902:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778959.212929:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+20:3650:x1877767663713792:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778959.212935:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790778959.213011:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663713792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778959.213020:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663714048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778959.213055:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663713280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778959.213063:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663713664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790778959.216266:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778959.216307:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642683904 00000100:00100000:3.0:1790778959.216317:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642683904 00010000:00010000:3.0:1790778959.216364:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936cb47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425676 expref: 10 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778959.216403:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:3.0:1790778959.216414:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2401:x1877767642683904:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778959.216433:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778959.216452:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936cb47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425676 expref: 10 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.216466:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936cb47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425676 expref: 10 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.216494:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.216504:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.216524:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.216533:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.216541:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.216549:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.216555:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790778959.216561:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.216571:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.216580:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.216599:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778959.218265:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2401:x1877767642683904:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1831us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778959.218281:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00010000:00010000:0.0:1790778959.219017:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936cb47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425676 expref: 9 pid: 6515 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778959.219035:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1877767663713024:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790778959.219084:0:10397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.219252:0:10397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.219339:0:10397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778959.219345:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936cc0b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778959.450662:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778959.450767:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642684032 00000100:00100000:3.0:1790778959.450777:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642684032 00000100:00100000:3.0:1790778959.450868:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00100000:3.0:1790778959.450917:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:6170:x1877767642684032:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778959.450935:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778959.450955:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936cc12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b4256bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.450982:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936cc12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256bc expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.450992:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936cc12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256bc expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778959.451000:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6c00, rc 0) 00000100:00100000:3.0:1790778959.451052:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6170:x1877767642684032:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 176us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778959.451059:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00100000:1.0:1790778959.457470:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778959.457549:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642684160 00000100:00100000:0.0:1790778959.457559:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642684160 00000100:00100000:0.0:1790778959.457620:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:0.0:1790778959.457630:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6170:x1877767642684160:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778959.457832:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6170:x1877767642684160:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 203us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778959.457841:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:2.0:1790778959.464221:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778959.464245:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663714176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790778959.464330:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778959.465008:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663714176 00000100:00100000:3.0:1790778959.465025:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663714176 00000100:00100000:3.0:1790778959.465175:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790778959.465188:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663714176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790778959.465262:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790778959.465382:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663714176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 196us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778959.465390:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790778959.465508:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663714176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790778959.471703:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778959.471837:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642684288 00000100:00100000:3.0:1790778959.471850:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642684288 00000100:00100000:3.0:1790778959.471947:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00100000:3.0:1790778959.471959:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6170:x1877767642684288:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778959.472166:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6170:x1877767642684288:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 209us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778959.472175:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00100000:2.0:1790778959.481529:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778959.482417:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642684416 00000100:00100000:3.0:1790778959.482432:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642684416 00000100:00100000:3.0:1790778959.482516:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:3.0:1790778959.482528:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7703020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6709:x1877767642684416:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790778959.482768:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7703020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6709:x1877767642684416:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 240us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778959.482777:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:1.0:1790778959.490552:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778959.490810:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642684544 00000100:00100000:0.0:1790778959.490825:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642684544 00000100:00100000:0.0:1790778959.490932:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 254 00000100:00100000:0.0:1790778959.490945:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6709:x1877767642684544:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790778959.491157:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:6709:x1877767642684544:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 214us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778959.491167:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 254 00010000:00010000:2.0:1790778959.791304:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778960.056493:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778960.056682:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642684672 00000100:00100000:0.0:1790778960.056695:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642684672 00000100:00100000:0.0:1790778960.056795:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 255 00000100:00100000:0.0:1790778960.056806:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2400:x1877767642684672:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790778960.056946:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2400:x1877767642684672:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 140us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.056956:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 255 00000100:00100000:2.0:1790778960.066758:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778960.066803:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778960.066826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778960.066861:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778960.066922:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642685056 00000100:00100000:2.0:1790778960.066928:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642685184 00000100:00100000:2.0:1790778960.066937:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642685184 00000100:00100000:3.0:1790778960.066938:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642685056 00000100:00100000:2.0:1790778960.067011:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:0.0:1790778960.067014:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642684800 00000100:00100000:0.0:1790778960.067021:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642684800 00000100:00100000:2.0:1790778960.067023:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642685184:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778960.067091:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642684928 00000100:00100000:1.0:1790778960.067104:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642684928 00000100:00100000:2.0:1790778960.067303:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642685184:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 282us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778960.067311:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1790778960.069549:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1790778960.069574:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642685056:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790778960.069666:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642685056:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 103us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778960.069675:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1790778960.071058:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:3.0:1790778960.071078:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642684800:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790778960.071181:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642684800:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 112us (4436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778960.071186:0:6523:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790778960.071193:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:1.0:1790778960.071199:0:6523:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790778960.071300:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:0.0:1790778960.071313:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642684928:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790778960.071407:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642684928:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 97us (4578us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.071415:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00080000:1.0:1790778960.071443:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790778960.071474:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790778960.071478:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790778960.071482:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:1.0:1790778960.744165:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790778960.744176:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b760310d000 from 4 10000000:01000000:1.0:1790778960.744182:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790778960.744241:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.744256:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.744269:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778960.744304:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663714304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790778960.744390:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778960.744451:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778960.744594:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663714304 00000100:00100000:3.0:1790778960.744606:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663714304 00000100:00100000:3.0:1790778960.744673:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790778960.744693:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663714304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778960.744711:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778960.744728:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936cc20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cc19 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.744758:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936cc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cc19 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.744771:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936cc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc19 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.744782:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6a00, rc 0) 00000100:00100000:3.0:1790778960.744980:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663714304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 297us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778960.744989:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1790778960.746169:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663714304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778960.746197:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.746210:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778960.746492:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663714432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778960.746553:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778960.746607:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778960.746630:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663714432 00000100:00100000:0.0:1790778960.746638:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663714432 00000100:00100000:0.0:1790778960.746694:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790778960.746705:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663714432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.746869:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663714432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.746898:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1790778960.747110:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663714432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778960.747158:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663714560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778960.747205:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778960.747234:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778960.747279:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663714560 00000100:00100000:3.0:1790778960.747283:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663714560 00000100:00100000:3.0:1790778960.747319:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1790778960.747327:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663714560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778960.747424:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663714560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778960.747437:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1790778960.747668:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663714560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778960.748202:0:10467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10467:1877767663714688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778960.748241:0:10467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778960.748298:0:10467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778960.749504:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663714688 00000100:00100000:3.0:1790778960.749517:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663714688 00000100:00100000:3.0:1790778960.749576:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790778960.749587:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:10467:x1877767663714688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778960.750230:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:10467:x1877767663714688:12345-0@lo:502:llog_process_th.0 Request processed in 640us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778960.750241:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1790778960.751208:0:10467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10467:1877767663714688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790778960.751255:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778960.751269:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778960.751271:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790778960.751278:0:10467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b760310d000 00000020:00000080:1.0:1790778960.751282:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790778960.751405:0:10467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10467:1877767663714816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778960.751468:0:10467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778960.751506:0:10467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778960.756196:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663714816 00000100:00100000:0.0:1790778960.756214:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663714816 00000100:00100000:0.0:1790778960.756296:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790778960.756307:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:10467:x1877767663714816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778960.756528:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:10467:x1877767663714816:12345-0@lo:502:llog_process_th.0 Request processed in 222us (5059us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.756537:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1790778960.756804:0:10467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10467:1877767663714816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790778960.756851:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778960.756861:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778960.756864:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790778960.756869:0:10467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790778960.757143:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790778960.757166:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790778960.757179:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778960.757193:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778960.757206:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790778960.757209:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b77344a6000 from 4 10000000:01000000:0.0:1790778960.757214:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790778960.757264:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778960.757273:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778960.757282:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778960.757306:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663714944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.757354:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778960.757402:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1840 going to sleep for 11 seconds 00000100:00100000:1.0:1790778960.757454:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663714944 00000100:00100000:1.0:1790778960.757460:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663714944 00000100:00100000:1.0:1790778960.757499:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790778960.757508:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663714944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778960.757532:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778960.757548:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936cc2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cc27 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.757575:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936cc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cc27 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.757588:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936cc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc27 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.757599:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cf000, rc 0) 00000100:00100000:1.0:1790778960.757636:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663714944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778960.757642:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790778960.757713:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663714944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778960.757728:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778960.757737:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778960.757805:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663715072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.757832:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778960.757852:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1840 going to sleep for 11 seconds 00000100:00100000:0.0:1790778960.757867:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663715072 00000100:00100000:0.0:1790778960.757871:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663715072 00000100:00100000:0.0:1790778960.757989:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790778960.757998:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663715072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.758133:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663715072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.758141:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790778960.758179:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663715072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.758208:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663715200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.758249:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778960.758278:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1840 going to sleep for 11 seconds 00000100:00100000:2.0:1790778960.758417:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663715200 00000100:00100000:2.0:1790778960.758424:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663715200 00000100:00100000:2.0:1790778960.758447:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790778960.758456:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663715200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778960.758554:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663715200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778960.758561:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790778960.758604:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663715200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778960.760544:0:10469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10469:1877767663715328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778960.760647:0:10469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778960.760688:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663715328 00000100:00100000:2.0:1790778960.760695:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663715328 00000100:00100000:2.0:1790778960.760742:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790778960.760751:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:10469:x1877767663715328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778960.761106:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:10469:x1877767663715328:12345-0@lo:502:llog_process_th.0 Request processed in 355us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778960.761122:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790778960.761183:0:10469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c480 going to sleep for 11 seconds 00000100:00100000:2.0:1790778960.761205:0:10469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10469:1877767663715328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790778960.761241:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790778960.761254:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778960.761257:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790778960.761265:0:10469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b77344a6000 00000020:00000080:2.0:1790778960.761268:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790778960.761363:0:10469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10469:1877767663715456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778960.761403:0:10469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778960.761429:0:10469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c480 going to sleep for 11 seconds 00000100:00100000:1.0:1790778960.761482:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663715456 00000100:00100000:1.0:1790778960.761487:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663715456 00000100:00100000:1.0:1790778960.761526:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790778960.761534:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:10469:x1877767663715456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778960.761641:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:10469:x1877767663715456:12345-0@lo:502:llog_process_th.0 Request processed in 108us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778960.761648:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790778960.761778:0:10469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10469:1877767663715456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790778960.761797:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778960.761802:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778960.761803:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790778960.761807:0:10469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790778960.767516:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790778960.767570:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790778960.767586:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.767612:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778960.767640:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790778960.767643:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7712708000 from 4 10000000:01000000:1.0:1790778960.767646:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790778960.767700:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.767709:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.767723:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778960.767755:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663715584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790778960.767845:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778960.768143:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f240 going to sleep for 11 seconds 00000100:00100000:1.0:1790778960.768190:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663715584 00000100:00100000:1.0:1790778960.768200:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663715584 00000100:00100000:1.0:1790778960.768302:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790778960.768315:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663715584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778960.768333:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778960.768352:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cc3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cc35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.768391:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cc3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cc35 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.768404:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cc3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc35 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.768429:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cea00, rc 0) 00000100:00100000:1.0:1790778960.768485:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663715584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778960.768493:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790778960.768694:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663715584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778960.768712:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778960.768722:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778960.768802:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663715712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778960.768838:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778960.768923:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b76f240 going to sleep for 11 seconds 00000100:00100000:0.0:1790778960.775808:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663715712 00000100:00100000:0.0:1790778960.775831:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663715712 00000100:00100000:0.0:1790778960.775927:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790778960.775940:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663715712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.776252:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663715712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (7410us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.776266:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790778960.776582:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663715712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.776693:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663715840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.776959:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778960.777071:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1000 going to sleep for 11 seconds 00000100:00100000:0.0:1790778960.777114:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663715840 00000100:00100000:0.0:1790778960.777122:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663715840 00000100:00100000:0.0:1790778960.777183:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790778960.777197:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663715840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.777566:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663715840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 371us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.777574:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790778960.777793:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663715840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.780240:0:10472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10472:1877767663715968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778960.782844:0:10472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778960.782955:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663715968 00000100:00100000:3.0:1790778960.782968:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663715968 00000100:00100000:3.0:1790778960.783041:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1790778960.783052:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:10472:x1877767663715968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778960.783311:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:10472:x1877767663715968:12345-0@lo:502:llog_process_th.0 Request processed in 260us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778960.783319:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790778960.788006:0:10472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1840 going to sleep for 11 seconds 00000100:00100000:0.0:1790778960.788062:0:10472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10472:1877767663715968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790778960.790862:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778960.790907:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778960.790982:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790778960.790996:0:10472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b7712708000 00000020:00000080:0.0:1790778960.790999:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790778960.791140:0:10472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10472:1877767663716096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778960.791247:0:10472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778960.791310:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663716096 00000100:00100000:0.0:1790778960.791320:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663716096 00000100:00100000:0.0:1790778960.794132:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790778960.794162:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:10472:x1877767663716096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778960.794400:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:10472:x1877767663716096:12345-0@lo:502:llog_process_th.0 Request processed in 253us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.794419:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790778960.794742:0:10472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1840 going to sleep for 11 seconds 00000100:00100000:0.0:1790778960.794782:0:10472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10472:1877767663716096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790778960.794827:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778960.794929:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778960.794933:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790778960.794941:0:10472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790778960.795124:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790778960.795158:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790778960.795173:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778960.795188:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778960.795200:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790778960.795204:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b77208a9000 from 4 10000000:01000000:2.0:1790778960.795207:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790778960.795251:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778960.795266:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778960.795277:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778960.795302:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663716224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790778960.795365:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778960.795415:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778960.795468:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663716224 00000100:00100000:0.0:1790778960.795478:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663716224 00000100:00100000:0.0:1790778960.795957:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1790778960.795968:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663716224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778960.795984:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778960.796002:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769e00/0xb1aa4014e936cc4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cc43 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778960.796031:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769e00/0xb1aa4014e936cc4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cc43 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778960.796044:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769e00/0xb1aa4014e936cc4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc43 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778960.796054:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769e00, rc 0) 00000100:00100000:0.0:1790778960.796125:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663716224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.796133:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1790778960.796241:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663716224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778960.796261:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.796273:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778960.796370:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663716352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778960.796407:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778960.796584:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b770340b600 going to sleep for 11 seconds 00000100:00100000:2.0:1790778960.796640:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663716352 00000100:00100000:2.0:1790778960.796645:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663716352 00000100:00100000:2.0:1790778960.796675:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1790778960.796682:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663716352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778960.796853:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663716352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778960.796861:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790778960.798261:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663716352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778960.798332:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663716480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778960.798407:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778960.799897:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b770340b600 going to sleep for 11 seconds 00000100:00100000:0.0:1790778960.801100:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663716480 00000100:00100000:0.0:1790778960.801115:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663716480 00000100:00100000:0.0:1790778960.801233:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1790778960.801253:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663716480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.801450:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663716480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (3041us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.801460:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1790778960.806399:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663716480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778960.812300:0:10475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10475:1877767663716608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778960.812404:0:10475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778960.812456:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663716608 00000100:00100000:0.0:1790778960.812465:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663716608 00000100:00100000:0.0:1790778960.812522:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1790778960.812532:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:10475:x1877767663716608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778960.812674:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:10475:x1877767663716608:12345-0@lo:502:llog_process_th.0 Request processed in 143us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.812684:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1790778960.812751:0:10475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1000 going to sleep for 11 seconds 00000100:00100000:0.0:1790778960.812778:0:10475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10475:1877767663716608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790778960.812812:0:10475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778960.812825:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778960.812828:0:10475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790778960.812836:0:10475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b77208a9000 00000020:00000080:0.0:1790778960.812839:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790778960.813195:0:10475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10475:1877767663716736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778960.813237:0:10475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778960.813263:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663716736 00000100:00100000:0.0:1790778960.813269:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663716736 00000100:00100000:0.0:1790778960.813305:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1790778960.813311:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:10475:x1877767663716736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778960.813389:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:10475:x1877767663716736:12345-0@lo:502:llog_process_th.0 Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778960.813397:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1790778960.813430:0:10475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1000 going to sleep for 11 seconds 00000100:00100000:0.0:1790778960.813444:0:10475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:10475:1877767663716736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790778960.813465:0:10475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778960.813470:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778960.813472:0:10475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790778960.813476:0:10475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00010000:00010000:2.0:1790778960.817280:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790778960.817324:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790778960.817375:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790778960.817390:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778960.817406:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778961.000766:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663716864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778961.000868:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778961.001074:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663716864 00000100:00100000:1.0:1790778961.001096:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663716864 00000100:00100000:1.0:1790778961.001182:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790778961.001196:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663716864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778961.001240:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778961.001310:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663716864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778961.001319:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1790778961.001391:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790778961.001643:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a9880 x1877767663716864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778961.001666:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663716864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778961.003004:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663716992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790778961.003074:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778961.003288:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663716992 00000100:00100000:2.0:1790778961.003297:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663716992 00000100:00100000:2.0:1790778961.003379:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790778961.003387:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663716992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790778961.003410:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778961.003463:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663716992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778961.003470:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1790778961.003530:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790778961.004620:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b76ad80 x1877767663716992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778961.004647:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663716992:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790778961.839691:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778962.024262:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663717120:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.024380:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778962.024455:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663717632:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.024488:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663717248:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.024498:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778962.024522:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663718144:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.024525:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778962.024541:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663717760:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.024547:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778962.024560:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778962.024565:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663718656:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.024574:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663718272:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.024583:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778962.024592:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778962.024602:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790778962.024607:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790778962.024608:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663717504:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.024612:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663717376:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.024629:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778962.024629:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778962.024642:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663717888:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.024642:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663718016:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.024661:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778962.024662:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778962.024671:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663718400:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.024676:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663718528:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.024689:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778962.024693:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778962.024719:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663717248 00000100:00100000:1.0:1790778962.024719:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663717632 00000100:00100000:3.0:1790778962.024728:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663717248 00000100:00100000:1.0:1790778962.024728:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663717632 00000100:00100000:3.0:1790778962.024766:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663717760 00000100:00100000:1.0:1790778962.024766:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663717376 00000100:00100000:1.0:1790778962.024769:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663717376 00000100:00100000:3.0:1790778962.024776:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663717760 00000100:00100000:1.0:1790778962.024784:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790778962.024793:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663717632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.024796:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663718272 00000100:00100000:3.0:1790778962.024798:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663718272 00000100:00100000:3.0:1790778962.024809:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663717504 00000100:00100000:3.0:1790778962.024811:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663717504 00000100:00100000:3.0:1790778962.024820:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663717888 00000100:00100000:3.0:1790778962.024822:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663717888 00000100:00100000:3.0:1790778962.024833:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663718400 00000100:00100000:3.0:1790778962.024835:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663718400 00000100:00100000:3.0:1790778962.024849:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790778962.024853:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663717632:12345-0@lo:400:kworker.0 Request processed in 61us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778962.024861:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663717248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.024862:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790778962.024905:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790778962.024918:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663717376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.024920:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663717248:12345-0@lo:400:kworker.0 Request processed in 60us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778962.024926:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790778962.024940:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790778962.024946:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663717760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.024946:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663717376:12345-0@lo:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778962.024952:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790778962.024970:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663718144 00000100:00100000:3.0:1790778962.024973:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663717760:12345-0@lo:400:kworker.0 Request processed in 27us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778962.024973:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663718144 00000100:00100000:3.0:1790778962.024978:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790778962.024988:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790778962.024989:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663718656 00000100:00100000:1.0:1790778962.024991:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663718656 00000100:00100000:3.0:1790778962.024993:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663718272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.025003:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663718016 00000100:00100000:1.0:1790778962.025005:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663718016 00000100:00100000:1.0:1790778962.025016:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663718528 00000100:00100000:3.0:1790778962.025018:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663718272:12345-0@lo:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778962.025018:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663718528 00000100:00100000:3.0:1790778962.025024:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790778962.025031:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790778962.025033:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790778962.025036:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663718144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.025037:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663717504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.025074:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663717504:12345-0@lo:400:kworker.0 Request processed in 36us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778962.025074:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663718144:12345-0@lo:400:kworker.0 Request processed in 36us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778962.025091:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790778962.025100:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790778962.025102:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790778962.025108:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663718656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.025110:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790778962.025115:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663717888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.025135:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663718656:12345-0@lo:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778962.025137:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663717888:12345-0@lo:400:kworker.0 Request processed in 22us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778962.025141:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790778962.025142:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790778962.025151:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790778962.025151:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790778962.025157:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663718400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.025157:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663718016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.025181:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663718400:12345-0@lo:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778962.025181:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663718016:12345-0@lo:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778962.025188:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790778962.025188:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790778962.025203:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790778962.025209:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663718528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.025231:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663717376:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.025233:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663718528:12345-0@lo:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778962.025239:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1790778962.025245:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ece00 x1877767663717888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778962.025255:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663717888:0@lo:400:kworker.0 00010000:00080000:3.0:1790778962.025265:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ec380 x1877767663718400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778962.025273:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663718400:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.025277:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663717504:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.025282:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663717248:0@lo:400:kworker.0 00010000:00080000:1.0:1790778962.025287:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ec000 x1877767663718016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778962.025291:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663717760:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.025295:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663718016:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.025299:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663718272:0@lo:400:kworker.0 00010000:00080000:1.0:1790778962.025303:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4edc00 x1877767663718528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778962.025309:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663718528:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.025317:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663717632:0@lo:400:kworker.0 00010000:00080000:1.0:1790778962.025325:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ef480 x1877767663718144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778962.025333:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663718144:0@lo:400:kworker.0 00010000:00080000:1.0:1790778962.025341:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ef100 x1877767663718656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778962.025348:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663718656:0@lo:400:kworker.0 00000100:00100000:0.0:1790778962.026224:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663717120 00000100:00100000:0.0:1790778962.026232:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663717120 00000100:00100000:0.0:1790778962.026289:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1790778962.026299:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663717120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778962.026385:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663717120:12345-0@lo:400:kworker.0 Request processed in 87us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778962.026392:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:0.0:1790778962.026430:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790778962.026436:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790778962.026439:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778962.026623:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663717120:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.026795:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663718912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790778962.026839:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778962.026911:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778962.026926:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663718784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790778962.026952:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778962.027040:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663718912 00000100:00100000:2.0:1790778962.027045:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663718912 00000100:00100000:2.0:1790778962.027095:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663718784 00000100:00100000:2.0:1790778962.027099:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663718784 00000100:00100000:2.0:1790778962.027113:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790778962.027120:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663718912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790778962.027152:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778962.027195:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663718912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778962.027202:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790778962.027215:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790778962.027221:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663718784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778962.027231:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778962.027253:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663718784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778962.027260:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1790778962.027692:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603964a80 x1877767663718784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778962.027713:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663718784:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1790778962.027725:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603912680 x1877767663718912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778962.027736:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663718912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790778962.536259:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663719040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790778962.536361:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778962.536500:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663719040 00000100:00100000:2.0:1790778962.536511:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663719040 00000100:00100000:2.0:1790778962.536580:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790778962.536592:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663719040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790778962.536636:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790778962.536713:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663719040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778962.536721:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790778962.536876:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663719040:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790778962.858607:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778963.880054:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778964.584363:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778964.584385:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663719168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790778964.584451:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778964.584524:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663719168 00000100:00100000:0.0:1790778964.584532:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663719168 00000100:00100000:0.0:1790778964.584572:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790778964.584580:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663719168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790778964.584613:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790778964.584657:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663719168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778964.584664:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790778964.584705:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663719168:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790778964.904093:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778965.172542:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778965.172591:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778965.172624:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642685312 00000100:00100000:3.0:1790778965.172641:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642685312 00000100:00100000:1.0:1790778965.175084:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778965.175114:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778965.175139:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778965.175172:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642685568 00000100:00100000:1.0:1790778965.175183:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642685568 00000100:00100000:1.0:1790778965.175253:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642685440 00000100:00100000:1.0:1790778965.175257:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642685440 00000100:00100000:1.0:1790778965.175283:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:1.0:1790778965.175293:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642685568:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778965.175370:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642685568:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 77us (2778us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778965.175387:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:1.0:1790778965.175407:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:1.0:1790778965.175413:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642685440:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778965.175442:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642685440:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778965.175448:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:1.0:1790778965.175468:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642685824 00000100:00100000:1.0:1790778965.175472:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642685824 00000100:00100000:1.0:1790778965.175496:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642685696 00000100:00100000:1.0:1790778965.175499:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642685696 00000100:00100000:1.0:1790778965.175516:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1790778965.175522:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642685824:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778965.175547:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642685824:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778965.175554:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1790778965.175565:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:1.0:1790778965.175571:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642685696:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778965.175592:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642685696:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778965.175597:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00080000:1.0:1790778965.175612:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790778965.175616:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778965.175618:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790778965.175620:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790778965.177161:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 277 00000100:00100000:2.0:1790778965.177179:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2398:x1877767642685312:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790778965.177232:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2398:x1877767642685312:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 61us (4698us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778965.177240:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 277 00000001:02000400:1.0:1790778965.362633:0:10698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1790778965.928096:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778966.120015:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778966.120034:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663719296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790778966.120115:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778966.120177:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663719296 00000100:00100000:1.0:1790778966.120184:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663719296 00000100:00100000:1.0:1790778966.120226:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790778966.120236:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663719296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790778966.120264:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778966.120305:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663719296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778966.120313:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1790778966.120334:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790778966.120360:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a9f80 x1877767663719296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778966.120378:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663719296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790778966.121081:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778966.121094:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663719424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778966.121131:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778966.121859:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663719424 00000100:00100000:1.0:1790778966.121866:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663719424 00000100:00100000:1.0:1790778966.121945:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790778966.121954:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663719424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778966.121970:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778966.122016:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663719424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778966.122023:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1790778966.122090:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790778966.122113:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603832680 x1877767663719424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778966.122128:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663719424:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790778966.954141:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778967.147666:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663719552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790778967.147730:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778967.147818:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663719552 00000100:00100000:0.0:1790778967.147835:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663719552 00000100:00100000:0.0:1790778967.147906:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790778967.147915:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663719552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790778967.147943:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778967.147983:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663719552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778967.147998:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1790778967.148163:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790778967.148199:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603910380 x1877767663719552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778967.148216:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663719552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790778967.148338:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778967.148536:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663719808:0@lo:400:kworker.0 00000100:00100000:0.0:1790778967.148570:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778967.148609:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663719808 00000100:00100000:0.0:1790778967.148613:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663719808 00000100:00100000:0.0:1790778967.148643:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790778967.148649:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663719808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778967.148685:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663719808:12345-0@lo:400:kworker.0 Request processed in 36us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778967.148691:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790778967.148723:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663719808:0@lo:400:kworker.0 00000100:00100000:0.0:1790778967.148750:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778967.148756:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663719936:0@lo:400:kworker.0 00000100:00100000:0.0:1790778967.148779:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778967.150817:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663720064:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.150896:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778967.150925:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663719680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790778967.150946:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778967.150977:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663719936 00000100:00100000:1.0:1790778967.150984:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663719936 00000100:00100000:1.0:1790778967.151031:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790778967.151048:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663719936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.151103:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663719936:12345-0@lo:400:kworker.0 Request processed in 64us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778967.151110:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790778967.151134:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663719680 00000100:00100000:1.0:1790778967.151138:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663719680 00000100:00100000:1.0:1790778967.151168:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790778967.151174:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663719680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790778967.151190:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778967.151224:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663719680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778967.151230:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1790778967.151247:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790778967.151271:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ed500 x1877767663719680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778967.151303:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663719680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790778967.151588:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663719936:0@lo:400:kworker.0 00000100:00100000:2.0:1790778967.151662:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663720064 00000100:00100000:2.0:1790778967.151667:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663720064 00000100:00100000:2.0:1790778967.151705:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790778967.151712:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663720064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778967.151753:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663720064:12345-0@lo:400:kworker.0 Request processed in 42us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778967.151759:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790778967.151814:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663720064:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.155201:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663720192:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.155264:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778967.155303:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663720704:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.155337:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778967.155364:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790778967.155370:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663720576:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.155391:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778967.155421:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663721088:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.155441:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778967.155471:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663720704 00000100:00100000:1.0:1790778967.155479:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663720704 00000100:00100000:1.0:1790778967.155524:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790778967.155534:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663720704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.155585:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663720704:12345-0@lo:400:kworker.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778967.155593:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790778967.155613:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663720192 00000100:00100000:1.0:1790778967.155617:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663720192 00000100:00100000:1.0:1790778967.155638:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663720576 00000100:00100000:1.0:1790778967.155640:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663720576 00000100:00100000:1.0:1790778967.155656:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663721088 00000100:00100000:1.0:1790778967.155670:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663721088 00000100:00100000:1.0:1790778967.155685:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790778967.155690:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663720192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.155718:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663720192:12345-0@lo:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778967.155724:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790778967.155734:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790778967.155739:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663720576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.155759:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663720576:12345-0@lo:400:kworker.0 Request processed in 20us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778967.155764:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790778967.155773:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790778967.155778:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663721088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.155796:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663721088:12345-0@lo:400:kworker.0 Request processed in 19us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778967.155801:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1790778967.155835:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603910380 x1877767663720576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778967.155848:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663720576:0@lo:400:kworker.0 00010000:00080000:1.0:1790778967.155857:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603022300 x1877767663721088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778967.155865:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663721088:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.155873:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663720192:0@lo:400:kworker.0 00010000:00080000:1.0:1790778967.155904:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b76ad80 x1877767663720704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778967.155918:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663720704:0@lo:400:kworker.0 00000100:00080000:1.0:1790778967.155948:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790778967.155958:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663720320:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.155985:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778967.156002:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663720832:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.156034:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778967.156059:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790778967.156065:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663720448:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.156082:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778967.156094:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663720960:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.156109:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778967.156126:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663720832 00000100:00100000:1.0:1790778967.156130:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663720832 00000100:00100000:1.0:1790778967.156149:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790778967.156154:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663720832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.156182:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663720832:12345-0@lo:400:kworker.0 Request processed in 28us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778967.156188:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790778967.156201:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663720448 00000100:00100000:1.0:1790778967.156203:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663720448 00000100:00100000:1.0:1790778967.156219:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663720960 00000100:00100000:1.0:1790778967.156221:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663720960 00000100:00100000:1.0:1790778967.156232:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790778967.156237:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663720448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.156259:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663720448:12345-0@lo:400:kworker.0 Request processed in 22us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778967.156270:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790778967.156281:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790778967.156287:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663720960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.156314:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663720960:12345-0@lo:400:kworker.0 Request processed in 27us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778967.156319:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1790778967.156337:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778967.156348:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663720320 00000100:00100000:1.0:1790778967.156352:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663720320 00000100:00100000:1.0:1790778967.156374:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790778967.156380:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663720320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.156410:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663720320:12345-0@lo:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778967.156416:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790778967.156446:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663720448:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.156455:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663720960:0@lo:400:kworker.0 00000100:00100000:1.0:1790778967.156463:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663720320:0@lo:400:kworker.0 00010000:00080000:1.0:1790778967.156471:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c0e680 x1877767663720832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778967.156478:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663720832:0@lo:400:kworker.0 00000100:00100000:3.0:1790778967.658750:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663721216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790778967.658828:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778967.658926:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663721216 00000100:00100000:3.0:1790778967.658934:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663721216 00000100:00100000:3.0:1790778967.658979:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790778967.658989:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663721216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790778967.659025:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790778967.659090:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663721216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778967.659098:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790778967.659164:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663721216:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790778967.980617:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778969.000299:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790778969.629600:0:10942:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing yml_node 00000100:00100000:1.0:1790778969.710282:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663721344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790778969.710361:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778969.710502:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663721344 00000100:00100000:3.0:1790778969.710510:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663721344 00000100:00100000:3.0:1790778969.710559:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790778969.710566:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663721344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790778969.710596:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790778969.717155:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663721344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6578us (6783us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778969.717169:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790778969.718135:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663721344:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790778970.023985:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778970.312207:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778970.312253:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778970.312275:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778970.312300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778970.312327:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778970.312351:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642686336 00000100:00100000:1.0:1790778970.312360:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642686336 00000100:00100000:1.0:1790778970.312409:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642686464 00000100:00100000:1.0:1790778970.312413:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642686464 00000100:00100000:1.0:1790778970.312435:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1790778970.312444:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2397:x1877767642686336:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:1.0:1790778970.312479:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cb5c 00000100:00080000:1.0:1790778970.312489:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9b76038f5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790778970.312547:0:8440:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1790778970.312697:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+2:2397:x1877767642686336:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 254us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778970.312705:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1790778970.312721:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1790778970.312728:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2397:x1877767642686464:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:1.0:1790778970.312741:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cb63 00000100:00080000:1.0:1790778970.312748:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9b76038f0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790778970.312771:0:8440:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1790778970.312834:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+2:2397:x1877767642686464:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 106us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778970.312849:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1790778970.312870:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642685952 00000100:00100000:1.0:1790778970.312874:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642685952 00000100:00100000:1.0:1790778970.312920:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 279 00000100:00100000:1.0:1790778970.312926:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2401:x1877767642685952:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778970.312950:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2401:x1877767642685952:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 24us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778970.312956:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 279 00000100:00100000:1.0:1790778970.312979:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642686080 00000100:00100000:1.0:1790778970.312982:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642686080 00000100:00100000:1.0:1790778970.313003:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642686208 00000100:00100000:1.0:1790778970.313005:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642686208 00000100:00100000:1.0:1790778970.313034:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:1.0:1790778970.313040:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642686080:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778970.313065:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642686080:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778970.313071:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:1.0:1790778970.313081:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:1.0:1790778970.313087:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642686208:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778970.313111:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642686208:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778970.313116:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00080000:1.0:1790778970.313132:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790778970.313137:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790778970.313140:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778970.313148:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790778970.313162:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778970.313285:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778971.048068:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778971.241598:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663721472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778971.242768:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790778971.242785:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663721600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790778971.242842:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778971.243107:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663721600 00000100:00100000:2.0:1790778971.243117:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663721600 00000100:00100000:2.0:1790778971.243187:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790778971.243199:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663721600:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790778971.243310:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790778971.243404:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778971.243417:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663721472 00000100:00100000:1.0:1790778971.243421:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663721472 00000100:00100000:1.0:1790778971.243456:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790778971.243463:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663721472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778971.243481:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778971.243526:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663721472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778971.243533:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00002000:00000024:2.0:1790778971.243731:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1790778971.243739:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790778971.243770:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603832680 x1877767663721472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778971.243786:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663721600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 590us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778971.243800:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790778971.243819:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663721472:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1790778971.243876:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603965880 x1877767663721600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778971.243910:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663721600:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790778972.072442:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778972.264380:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663721728:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.264449:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778972.264517:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663722240:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.264559:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778972.264580:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663722752:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.264603:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778972.264630:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790778972.264635:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663722112:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.264658:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778972.264676:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663722624:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.264695:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778972.264727:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663721728 00000100:00100000:0.0:1790778972.264734:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663721728 00000100:00100000:0.0:1790778972.264775:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1790778972.264783:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663721728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.264829:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663721728:12345-0@lo:400:kworker.0 Request processed in 47us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778972.264836:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1790778972.264896:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663721728:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.264939:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663722752 00000100:00100000:0.0:1790778972.264942:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663722752 00000100:00100000:0.0:1790778972.264966:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663722624 00000100:00100000:0.0:1790778972.264969:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663722624 00000100:00100000:0.0:1790778972.264988:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790778972.264995:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663722752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265048:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663722752:12345-0@lo:400:kworker.0 Request processed in 53us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778972.265054:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790778972.265075:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790778972.265081:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663722624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265111:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663722624:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778972.265117:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790778972.265139:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663721856:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265163:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778972.265183:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663722368:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265203:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778972.265220:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663722880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790778972.265241:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778972.265537:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790778972.265545:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663721984:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265569:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778972.265584:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663722496:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265602:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778972.265626:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663722112 00000100:00100000:0.0:1790778972.265629:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663722112 00000100:00100000:0.0:1790778972.265649:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663721856 00000100:00100000:0.0:1790778972.265651:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663721856 00000100:00100000:0.0:1790778972.265660:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663722368 00000100:00100000:0.0:1790778972.265662:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663722368 00000100:00100000:0.0:1790778972.265678:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663722496 00000100:00100000:0.0:1790778972.265680:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663722496 00000100:00100000:0.0:1790778972.265692:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790778972.265697:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663722112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265728:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663722112:12345-0@lo:400:kworker.0 Request processed in 30us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778972.265741:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790778972.265754:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790778972.265760:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663721856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265790:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663721856:12345-0@lo:400:kworker.0 Request processed in 31us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778972.265797:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790778972.265807:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790778972.265812:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663722368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265836:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663722368:12345-0@lo:400:kworker.0 Request processed in 24us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778972.265841:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790778972.265851:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790778972.265856:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663722496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265899:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663722496:12345-0@lo:400:kworker.0 Request processed in 23us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778972.265906:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:0.0:1790778972.265932:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603912d80 x1877767663722496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778972.265944:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663722496:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265954:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663721856:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265961:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663722368:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.265993:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663722112:0@lo:400:kworker.0 00010000:00080000:0.0:1790778972.266017:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603910380 x1877767663722624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778972.266033:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663722624:0@lo:400:kworker.0 00010000:00080000:0.0:1790778972.266046:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a9f80 x1877767663722752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778972.266056:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663722752:0@lo:400:kworker.0 00000100:00100000:0.0:1790778972.266126:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663722880 00000100:00100000:0.0:1790778972.266130:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663722880 00000100:00100000:0.0:1790778972.266155:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790778972.266161:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663722880:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790778972.268081:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663722240 00000100:00100000:2.0:1790778972.268101:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663722240 00000100:00100000:2.0:1790778972.268133:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663721984 00000100:00100000:2.0:1790778972.268136:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663721984 00000100:00100000:2.0:1790778972.268152:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790778972.268159:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663722240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.268257:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663722240:12345-0@lo:400:kworker.0 Request processed in 97us (3696us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778972.268264:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790778972.268280:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790778972.268286:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663721984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.268316:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663721984:12345-0@lo:400:kworker.0 Request processed in 30us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778972.268321:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790778972.268348:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663723008:0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.268382:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778972.268422:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663723008 00000100:00100000:2.0:1790778972.268426:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663723008 00000100:00100000:2.0:1790778972.268457:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790778972.268463:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663723008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.268495:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663723008:12345-0@lo:400:kworker.0 Request processed in 33us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778972.268502:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790778972.268537:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663721984:0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.268567:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663723008:0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.268597:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663723136:0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.268631:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778972.268651:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778972.268658:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663723264:0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.268681:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778972.268705:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663723136 00000100:00100000:2.0:1790778972.268709:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663723136 00000100:00100000:2.0:1790778972.268735:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790778972.268740:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663723136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.268774:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663723136:12345-0@lo:400:kworker.0 Request processed in 33us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778972.268780:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1790778972.268806:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d2d80 x1877767663723136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778972.268815:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663723136:0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.269046:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663723264 00000100:00100000:2.0:1790778972.269051:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663723264 00000100:00100000:2.0:1790778972.269113:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790778972.269121:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663723264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.269157:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663723264:12345-0@lo:400:kworker.0 Request processed in 38us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778972.269164:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1790778972.269188:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d0a80 x1877767663723264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778972.269198:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663723264:0@lo:400:kworker.0 00000100:00100000:2.0:1790778972.269846:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663722240:0@lo:400:kworker.0 00002000:00000024:0.0:1790778972.270370:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778972.270443:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663722880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4281us (5199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778972.270451:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1790778972.272215:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790778972.272222:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790778972.272225:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778972.273136:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778972.273157:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663723392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778972.273234:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778972.273508:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663723392 00000100:00100000:3.0:1790778972.273515:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663723392 00000100:00100000:3.0:1790778972.273564:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790778972.273573:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663723392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778972.273594:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790778972.273643:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663723392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778972.273649:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1790778972.273690:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ece00 x1877767663723392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778972.273710:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663723392:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790778972.277934:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603022300 x1877767663722880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778972.277961:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663722880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790778972.776301:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663723520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790778972.776367:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778972.776506:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663723520 00000100:00100000:2.0:1790778972.776524:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663723520 00000100:00100000:2.0:1790778972.776579:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790778972.776589:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663723520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790778972.776621:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790778972.776676:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663723520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778972.776693:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790778972.776731:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663723520:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790778973.097081:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790778973.831471:0:11125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.2 00010000:00010000:0.0:1790778974.121026:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778974.826172:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663723648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790778974.826239:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778974.826309:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663723648 00000100:00100000:0.0:1790778974.826316:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663723648 00000100:00100000:0.0:1790778974.826358:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790778974.826367:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663723648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790778974.826410:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790778974.826454:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663723648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778974.826462:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790778974.826506:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663723648:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790778975.144119:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778975.415784:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778975.415838:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778975.415873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778975.416092:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642686592 00000100:00100000:0.0:1790778975.416101:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642686592 00000100:00100000:0.0:1790778975.416159:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00100000:0.0:1790778975.416169:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2400:x1877767642686592:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790778975.416236:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2400:x1877767642686592:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 68us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778975.416244:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00100000:3.0:1790778975.417080:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642686848 00000100:00100000:3.0:1790778975.417087:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642686848 00000100:00100000:3.0:1790778975.417149:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642686720 00000100:00100000:3.0:1790778975.417152:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642686720 00000100:00100000:3.0:1790778975.417179:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:3.0:1790778975.417188:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642686848:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790778975.417241:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642686848:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 54us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778975.417248:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:3.0:1790778975.417280:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:3.0:1790778975.417287:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642686720:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790778975.417314:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642686720:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778975.417321:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00080000:0.0:1790778975.417568:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790778975.417573:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1790778975.850148:0:9517:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000020:00000080:1.0:1790778975.850158:0:9517:0:(genops.c:885:class_export_put()) final put ffff9b76038f4000/e5203316-d1cf-49fe-9b64-c701aab9b690 00000020:00000080:3.0:1790778975.850416:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b76038f4000/e5203316-d1cf-49fe-9b64-c701aab9b690 for lustre-OST0001 00000020:00000080:3.0:1790778975.850506:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b76038f0800 for lustre-OST0001 00000001:00100000:3.0:1790778975.850821:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000020:00000080:3.0:1790778975.850825:0:8432:0:(genops.c:885:class_export_put()) final put ffff9b76038f3800/e5203316-d1cf-49fe-9b64-c701aab9b690 00000020:00000080:1.0:1790778975.850902:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b76038f3800/e5203316-d1cf-49fe-9b64-c701aab9b690 for lustre-OST0000 00000020:00000080:1.0:1790778975.850928:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b76038f5000 for lustre-OST0000 00010000:00010000:2.0:1790778976.168923:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778976.361252:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778976.361279:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663723776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790778976.361352:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778976.361420:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663723776 00000100:00100000:2.0:1790778976.361428:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663723776 00000100:00100000:2.0:1790778976.361478:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790778976.361488:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663723776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790778976.361514:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778976.361559:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663723776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778976.361565:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1790778976.361585:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790778976.361609:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603964e00 x1877767663723776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778976.361641:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663723776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790778976.368513:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790778976.368549:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663723904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778976.368624:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778976.368699:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663723904 00000100:00100000:3.0:1790778976.368708:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663723904 00000100:00100000:3.0:1790778976.368764:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790778976.368772:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663723904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790778976.368793:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790778976.368837:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663723904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778976.368844:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1790778976.368866:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790778976.368909:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d0e00 x1877767663723904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778976.368925:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663723904:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1790778976.604352:0:11223:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.2 00010000:00010000:0.0:1790778977.201712:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778977.388723:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663724032:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.388797:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.388840:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663724544:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.388864:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.388916:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663725056:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389025:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.389047:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663725568:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389073:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.389109:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790778977.389114:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663724416:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389138:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.389157:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663724928:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389177:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.389194:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663725440:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389214:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.389243:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663724160:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389264:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.389280:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663724672:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389314:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.389333:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663725184:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389352:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.389370:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790778977.389377:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663724288:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389397:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.389417:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663724800:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389448:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.389461:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663725312:0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389480:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.389507:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663724032 00000100:00100000:3.0:1790778977.389514:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663724032 00000100:00100000:3.0:1790778977.389559:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1790778977.389567:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663724032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389617:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663724032:12345-0@lo:400:kworker.0 Request processed in 50us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778977.389624:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1790778977.389659:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663724544 00000100:00100000:3.0:1790778977.389662:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663724544 00000100:00100000:3.0:1790778977.389680:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663724288 00000100:00100000:3.0:1790778977.389683:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663724288 00000100:00100000:3.0:1790778977.389697:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790778977.389704:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663724544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389740:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663724544:12345-0@lo:400:kworker.0 Request processed in 36us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778977.389746:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790778977.389759:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790778977.389765:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663724288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.389799:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663724288:12345-0@lo:400:kworker.0 Request processed in 34us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778977.389805:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790778977.389851:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663725056 00000100:00100000:3.0:1790778977.389854:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663725056 00000100:00100000:3.0:1790778977.389872:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663725568 00000100:00100000:3.0:1790778977.389906:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663725568 00000100:00100000:3.0:1790778977.389929:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663724928 00000100:00100000:3.0:1790778977.389931:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663724928 00000100:00100000:1.0:1790778977.390050:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663725440 00000100:00100000:1.0:1790778977.390054:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663725440 00000100:00100000:1.0:1790778977.390075:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790778977.390081:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663725056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.390115:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663725056:12345-0@lo:400:kworker.0 Request processed in 34us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778977.390121:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790778977.390139:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790778977.390145:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663725568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.390170:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663725568:12345-0@lo:400:kworker.0 Request processed in 26us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778977.390176:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790778977.390311:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790778977.390318:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663725440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.390344:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663725440:12345-0@lo:400:kworker.0 Request processed in 27us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778977.390349:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790778977.390396:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663724416 00000100:00100000:1.0:1790778977.390400:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663724416 00000100:00100000:1.0:1790778977.390418:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663724160 00000100:00100000:1.0:1790778977.390420:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663724160 00000100:00100000:1.0:1790778977.390429:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663724672 00000100:00100000:1.0:1790778977.390431:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663724672 00000100:00100000:1.0:1790778977.390443:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663725184 00000100:00100000:1.0:1790778977.390445:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663725184 00000100:00100000:1.0:1790778977.390457:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663724800 00000100:00100000:1.0:1790778977.390459:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663724800 00000100:00100000:1.0:1790778977.390470:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663725312 00000100:00100000:1.0:1790778977.390473:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663725312 00000100:00100000:1.0:1790778977.390486:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790778977.390492:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663724416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.390523:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663724416:12345-0@lo:400:kworker.0 Request processed in 31us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778977.390528:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790778977.390538:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790778977.390543:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663724160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.390576:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663724160:12345-0@lo:400:kworker.0 Request processed in 32us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778977.390582:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790778977.390592:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790778977.390598:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663724672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.390623:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663724672:12345-0@lo:400:kworker.0 Request processed in 26us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778977.390629:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790778977.390641:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790778977.390647:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663725184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.390672:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663725184:12345-0@lo:400:kworker.0 Request processed in 26us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778977.390677:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790778977.390688:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790778977.390694:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663724800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.390716:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663724800:12345-0@lo:400:kworker.0 Request processed in 23us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778977.390722:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790778977.390733:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790778977.390739:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663725312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.390763:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663725312:12345-0@lo:400:kworker.0 Request processed in 25us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778977.390768:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790778977.390805:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790778977.390815:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663725696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790778977.390852:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778977.390923:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663724288:0@lo:400:kworker.0 00010000:00080000:1.0:1790778977.391027:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4edc00 x1877767663724800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778977.391039:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663724800:0@lo:400:kworker.0 00010000:00080000:1.0:1790778977.391055:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d4a80 x1877767663725312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778977.391063:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663725312:0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.391074:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663724160:0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.391084:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663724672:0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.391094:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663725184:0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.391136:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663724416:0@lo:400:kworker.0 00010000:00080000:1.0:1790778977.391147:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d6a00 x1877767663725440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778977.391157:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663725440:0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.391165:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663724032:0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.391175:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663724544:0@lo:400:kworker.0 00010000:00080000:1.0:1790778977.391184:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4eca80 x1877767663725056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778977.391192:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663725056:0@lo:400:kworker.0 00010000:00080000:1.0:1790778977.391212:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d5500 x1877767663725568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778977.391220:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663725568:0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.391280:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663725696 00000100:00100000:1.0:1790778977.391284:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663725696 00000100:00100000:1.0:1790778977.391310:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790778977.391317:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663725696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790778977.391339:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778977.391374:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663725696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778977.391381:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1790778977.391400:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790778977.391404:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790778977.391407:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790778977.391421:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d7b80 x1877767663725696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778977.391434:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663725696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778977.393114:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790778977.393127:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663724928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778977.393203:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663724928:12345-0@lo:400:kworker.0 Request processed in 78us (4023us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778977.393211:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1790778977.393258:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ec000 x1877767663724928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778977.393271:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663724928:0@lo:400:kworker.0 00000100:00100000:1.0:1790778977.395106:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663725824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790778977.395166:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.398026:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663725824 00000100:00100000:3.0:1790778977.398041:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663725824 00000100:00100000:3.0:1790778977.398094:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790778977.398105:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663725824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790778977.398132:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790778977.398212:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663725824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (3045us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778977.398219:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1790778977.398276:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d3480 x1877767663725824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778977.398298:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663725824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790778977.896381:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663725952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790778977.896455:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778977.896491:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663725952 00000100:00100000:3.0:1790778977.896501:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663725952 00000100:00100000:3.0:1790778977.896550:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790778977.896559:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663725952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790778977.896600:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790778977.896658:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663725952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778977.896666:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790778977.896696:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663725952:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790778978.216445:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778979.244913:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790778979.319666:0:11320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.2 00000100:00100000:3.0:1790778979.944154:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663726080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790778979.944239:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778979.945181:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663726080 00000100:00100000:0.0:1790778979.945192:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663726080 00000100:00100000:0.0:1790778979.945258:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790778979.945267:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663726080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790778979.945303:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790778979.945396:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663726080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778979.945403:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790778979.945547:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663726080:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790778980.267363:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778980.548729:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778980.552074:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778980.552197:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778980.552229:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642687232 00000100:00100000:1.0:1790778980.552237:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642687232 00000100:00100000:1.0:1790778980.552291:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642687104 00000100:00100000:1.0:1790778980.552301:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642687104 00000100:00100000:1.0:1790778980.552329:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:1.0:1790778980.552340:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642687232:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778980.552410:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642687232:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 72us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778980.552418:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:1.0:1790778980.552435:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 100 00000100:00100000:1.0:1790778980.552442:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642687104:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778980.552469:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642687104:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778980.552475:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 100 00000100:00080000:1.0:1790778980.552494:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790778980.552498:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790778980.552789:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642686976 00000100:00100000:0.0:1790778980.552831:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642686976 00000100:00100000:0.0:1790778980.552937:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 283 00000100:00100000:0.0:1790778980.552964:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2401:x1877767642686976:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790778980.553036:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2401:x1877767642686976:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 78us (4323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778980.553047:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 283 00000001:02000400:3.0:1790778980.993737:0:11368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 30 10:36:19 EDT 2026 00010000:00010000:1.0:1790778981.288492:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778981.480441:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778981.480466:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663726208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778981.480534:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778981.480727:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663726208 00000100:00100000:1.0:1790778981.480736:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663726208 00000100:00100000:1.0:1790778981.480803:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790778981.480826:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663726208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778981.480865:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778981.480956:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663726208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778981.480964:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1790778981.481004:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d3100 x1877767663726208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778981.481022:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663726208:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790778981.481327:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778981.484802:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778981.484835:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663726336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790778981.484948:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778981.485361:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663726336 00000100:00100000:1.0:1790778981.485381:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663726336 00000100:00100000:1.0:1790778981.485452:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790778981.485462:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663726336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790778981.485484:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778981.485541:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663726336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778981.485549:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1790778981.485647:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d3100 x1877767663726336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778981.485665:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663726336:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790778981.485722:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790778982.316085:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778982.506384:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663726592:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.506463:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.506509:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663727104:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.506567:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.506586:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663727616:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.506605:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.506619:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663728128:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.506635:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.506655:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1790778982.506661:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663726464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790778982.506679:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.506701:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663726976:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.506720:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.506733:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663727488:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.506748:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.506761:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663728000:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.506778:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.506806:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663726848:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.506829:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.506844:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663727360:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.506859:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.506872:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663727872:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.508057:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.508161:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1790778982.508171:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663726720:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.508208:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.508487:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663727232:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.508512:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778982.508530:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663726976 00000100:00100000:2.0:1790778982.508538:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663726976 00000100:00100000:2.0:1790778982.508574:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663727360 00000100:00100000:2.0:1790778982.508578:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663727360 00000100:00100000:2.0:1790778982.508601:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663727872 00000100:00100000:2.0:1790778982.508604:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663727872 00000100:00100000:2.0:1790778982.508617:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663726720 00000100:00100000:2.0:1790778982.508619:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663726720 00000100:00100000:2.0:1790778982.508633:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790778982.508641:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663726976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778982.508700:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663726976:12345-0@lo:400:kworker.0 Request processed in 59us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778982.508707:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790778982.508725:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790778982.508731:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663727360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778982.508761:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663727360:12345-0@lo:400:kworker.0 Request processed in 30us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778982.508766:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790778982.508787:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790778982.508793:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663727872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778982.508821:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663727872:12345-0@lo:400:kworker.0 Request processed in 28us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778982.508826:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790778982.508838:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790778982.508843:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663726720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778982.508869:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663726720:12345-0@lo:400:kworker.0 Request processed in 25us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778982.508874:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1790778982.508909:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790778982.508954:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663726976:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.509067:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663727744:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.509092:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778982.509288:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663728256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778982.509313:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790778982.509342:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760384e300 x1877767663727360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778982.509352:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663727360:0@lo:400:kworker.0 00010000:00080000:3.0:1790778982.509385:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760384c700 x1877767663727872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778982.509393:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663727872:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.509410:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663726720:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.509432:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663726592 00000100:00100000:3.0:1790778982.509436:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663726592 00000100:00100000:3.0:1790778982.509508:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790778982.509516:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663726592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.509555:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663726592:12345-0@lo:400:kworker.0 Request processed in 39us (3092us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778982.509561:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790778982.509589:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663727104 00000100:00100000:3.0:1790778982.509593:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663727104 00000100:00100000:3.0:1790778982.509609:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663726848 00000100:00100000:3.0:1790778982.509612:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663726848 00000100:00100000:3.0:1790778982.509624:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790778982.509630:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663727104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.509662:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663727104:12345-0@lo:400:kworker.0 Request processed in 32us (3093us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778982.509668:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790778982.509678:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790778982.509684:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663726848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.509714:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663726848:12345-0@lo:400:kworker.0 Request processed in 30us (2884us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778982.509719:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790778982.509744:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663727616 00000100:00100000:3.0:1790778982.509748:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663727616 00000100:00100000:3.0:1790778982.509764:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663728128 00000100:00100000:3.0:1790778982.509766:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663728128 00000100:00100000:3.0:1790778982.509784:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663727488 00000100:00100000:3.0:1790778982.509787:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663727488 00000100:00100000:3.0:1790778982.509797:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663728000 00000100:00100000:3.0:1790778982.509799:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663728000 00000100:00100000:3.0:1790778982.509812:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790778982.509818:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663727616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.509848:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663727616:12345-0@lo:400:kworker.0 Request processed in 30us (3241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778982.509854:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790778982.509864:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790778982.509870:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663728128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778982.510606:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663727232 00000100:00100000:2.0:1790778982.510615:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663727232 00000100:00100000:2.0:1790778982.510645:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663727744 00000100:00100000:2.0:1790778982.510648:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663727744 00000100:00100000:2.0:1790778982.510666:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790778982.510672:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663727232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778982.510716:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663727232:12345-0@lo:400:kworker.0 Request processed in 44us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778982.510723:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790778982.510736:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790778982.510742:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663727744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778982.510769:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663727744:12345-0@lo:400:kworker.0 Request processed in 28us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778982.510774:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1790778982.510807:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790778982.510811:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778982.510841:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663726592:0@lo:400:kworker.0 00000100:00100000:2.0:1790778982.510855:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663727104:0@lo:400:kworker.0 00010000:00080000:2.0:1790778982.510867:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760384dc00 x1877767663727616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778982.510877:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663727616:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.511001:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663728128:12345-0@lo:400:kworker.0 Request processed in 1131us (4364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778982.511009:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790778982.511022:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790778982.511029:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663727488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.511060:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663727488:12345-0@lo:400:kworker.0 Request processed in 32us (4310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778982.511065:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790778982.511078:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790778982.511083:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663728000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778982.511134:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663726464 00000100:00100000:0.0:1790778982.511139:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663726464 00000100:00100000:0.0:1790778982.511171:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663728256 00000100:00100000:0.0:1790778982.511175:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663728256 00000100:00100000:3.0:1790778982.511409:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1877767663728000:12345-0@lo:400:kworker.0 Request processed in 27us (4332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778982.511426:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790778982.511471:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790778982.511478:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663726464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790778982.511499:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790778982.511532:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663726464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (4852us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778982.511538:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790778982.511570:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663727232:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.511580:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663727744:0@lo:400:kworker.0 00000100:00100000:3.0:1790778982.511589:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663726848:0@lo:400:kworker.0 00000100:00100000:0.0:1790778982.511865:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790778982.511873:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663728256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790778982.511916:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778982.511968:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663728256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (2653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778982.511974:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1790778982.512009:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603020380 x1877767663728256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778982.512024:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663728256:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790778982.512773:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d7b80 x1877767663726464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778982.512789:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663726464:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1790778982.512802:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760384c380 x1877767663727488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778982.512811:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663727488:0@lo:400:kworker.0 00010000:00080000:2.0:1790778982.512821:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760384df80 x1877767663728000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778982.512829:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663728000:0@lo:400:kworker.0 00010000:00080000:2.0:1790778982.512838:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760384f800 x1877767663728128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778982.512845:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663728128:0@lo:400:kworker.0 00000100:00100000:2.0:1790778983.017121:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778983.017144:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663728384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790778983.017259:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778983.017396:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663728384 00000100:00100000:3.0:1790778983.017404:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663728384 00000100:00100000:3.0:1790778983.017457:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790778983.017466:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663728384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790778983.017498:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790778983.017564:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663728384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778983.017572:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790778983.017615:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663728384:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790778983.339661:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778984.364876:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778985.069244:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790778985.069834:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663728512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790778985.070140:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778985.070402:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663728512 00000100:00100000:1.0:1790778985.070411:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663728512 00000100:00100000:1.0:1790778985.070507:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790778985.070517:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663728512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790778985.070700:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790778985.070759:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663728512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 243us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778985.070766:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790778985.070835:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663728512:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790778985.384626:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778985.654998:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778985.655041:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778985.655066:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642687360 00000100:00100000:1.0:1790778985.655076:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642687360 00000100:00100000:0.0:1790778985.655079:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778985.655129:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 285 00000100:00100000:1.0:1790778985.655138:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2399:x1877767642687360:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778985.655213:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2399:x1877767642687360:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778985.655221:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 285 00000100:00100000:2.0:1790778985.655327:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642687616 00000100:00100000:2.0:1790778985.655332:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642687616 00000100:00100000:2.0:1790778985.655374:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642687488 00000100:00100000:2.0:1790778985.655377:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642687488 00000100:00100000:2.0:1790778985.655397:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 107 00000100:00100000:2.0:1790778985.655403:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642687616:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790778985.655437:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642687616:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778985.655445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 107 00000100:00100000:2.0:1790778985.655459:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 108 00000100:00100000:2.0:1790778985.655465:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2399:x1877767642687488:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790778985.655490:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2399:x1877767642687488:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778985.655496:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 108 00000100:00080000:1.0:1790778985.655538:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790778985.655542:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1790778986.408281:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778986.602289:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790778986.602319:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663728640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790778986.603923:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778986.604574:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663728640 00000100:00100000:0.0:1790778986.604591:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663728640 00000100:00100000:1.0:1790778986.604686:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663728768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790778986.604696:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790778986.604716:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663728640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790778986.604759:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778986.604767:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778986.604866:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663728640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778986.604875:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790778986.604933:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663728768 00000100:00100000:0.0:1790778986.604938:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663728768 00000100:00100000:0.0:1790778986.604959:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790778986.604966:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663728768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790778986.604980:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778986.605027:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663728768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (262us total) trans 0 rc 0/0 00000100:00080000:1.0:1790778986.605028:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778986.605043:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1790778986.605098:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d3800 x1877767663728768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778986.605121:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663728768:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1790778986.605161:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d0700 x1877767663728640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778986.605176:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663728640:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790778987.434847:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778987.624144:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663728896:0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.624195:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663729280:0@lo:400:kworker.0 00000100:00100000:2.0:1790778987.624215:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778987.624238:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778987.624274:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663729408:0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.624275:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663729792:0@lo:400:kworker.0 00000100:00100000:2.0:1790778987.624310:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778987.624316:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778987.624340:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663730304:0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.624359:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778987.624376:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663729920:0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.624389:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663729024:0@lo:400:kworker.0 00000100:00100000:2.0:1790778987.624403:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778987.624423:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778987.624427:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663730432:0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.624450:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663729536:0@lo:400:kworker.0 00000100:00100000:2.0:1790778987.624456:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778987.624483:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778987.624495:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663728896 00000100:00100000:2.0:1790778987.624502:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663728896 00000100:00100000:3.0:1790778987.624506:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663730048:0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.624533:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778987.624549:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1790778987.624558:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790778987.624559:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663728896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.624566:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663729152:0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.624595:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778987.624618:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663729664:0@lo:400:kworker.0 00000100:00100000:2.0:1790778987.624638:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663728896:12345-0@lo:400:kworker.0 Request processed in 79us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.624646:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778987.624649:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1790778987.624661:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663730176:0@lo:400:kworker.0 00000100:00100000:2.0:1790778987.624686:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663729408 00000100:00100000:2.0:1790778987.624692:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663729408 00000100:00100000:3.0:1790778987.624698:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778987.624718:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663729152 00000100:00100000:2.0:1790778987.624721:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663729152 00000100:00100000:2.0:1790778987.624738:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790778987.624745:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663729408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778987.624781:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663729408:12345-0@lo:400:kworker.0 Request processed in 37us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778987.624787:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790778987.624801:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790778987.624807:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663729152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.624815:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663729280 00000100:00100000:3.0:1790778987.624821:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663729280 00000100:00100000:2.0:1790778987.624844:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663729152:12345-0@lo:400:kworker.0 Request processed in 37us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.624846:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663729024 00000100:00100000:3.0:1790778987.624850:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663729024 00000100:00100000:2.0:1790778987.624854:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790778987.624875:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663729536 00000100:00100000:3.0:1790778987.624914:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663729536 00000100:00100000:3.0:1790778987.624938:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663730048 00000100:00100000:3.0:1790778987.624940:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663730048 00000100:00100000:3.0:1790778987.624951:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663729664 00000100:00100000:3.0:1790778987.624953:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663729664 00000100:00100000:3.0:1790778987.624964:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663730176 00000100:00100000:3.0:1790778987.624967:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663730176 00000100:00100000:3.0:1790778987.624979:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790778987.624985:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663729280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.625031:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663729280:12345-0@lo:400:kworker.0 Request processed in 45us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.625037:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790778987.625053:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790778987.625058:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663729024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.625088:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663729024:12345-0@lo:400:kworker.0 Request processed in 29us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.625093:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790778987.625104:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790778987.625109:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663729536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.625136:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663729536:12345-0@lo:400:kworker.0 Request processed in 27us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.625142:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790778987.625154:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790778987.625160:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663730048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.625191:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663730048:12345-0@lo:400:kworker.0 Request processed in 32us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.625206:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790778987.625222:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790778987.625228:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663729664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.625260:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663729664:12345-0@lo:400:kworker.0 Request processed in 33us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.625265:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790778987.625278:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790778987.625284:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663730176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.625310:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663730176:12345-0@lo:400:kworker.0 Request processed in 28us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.625316:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790778987.625332:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663729792 00000100:00100000:3.0:1790778987.625336:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663729792 00000100:00100000:3.0:1790778987.625354:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663730304 00000100:00100000:3.0:1790778987.625356:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663730304 00000100:00100000:3.0:1790778987.625369:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663729920 00000100:00100000:3.0:1790778987.625372:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663729920 00000100:00100000:3.0:1790778987.625381:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663730432 00000100:00100000:3.0:1790778987.625383:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663730432 00000100:00100000:3.0:1790778987.625397:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790778987.625402:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663729792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.625434:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663729792:12345-0@lo:400:kworker.0 Request processed in 31us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.625440:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790778987.625451:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790778987.625456:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663730304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.625505:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663730304:12345-0@lo:400:kworker.0 Request processed in 47us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.625511:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790778987.625524:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790778987.625530:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663729920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.625562:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663729920:12345-0@lo:400:kworker.0 Request processed in 32us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.625568:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790778987.625579:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790778987.625586:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663730432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.625615:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663730432:12345-0@lo:400:kworker.0 Request processed in 30us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.625621:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1790778987.625668:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790778987.625674:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790778987.625678:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778987.625706:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663729280:0@lo:400:kworker.0 00010000:00080000:3.0:1790778987.625719:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603993100 x1877767663729792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778987.625729:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663729792:0@lo:400:kworker.0 00010000:00080000:3.0:1790778987.625739:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603992680 x1877767663730304/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778987.625746:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663730304:0@lo:400:kworker.0 00000100:00100000:0.0:1790778987.627727:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778987.628170:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663730560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790778987.628242:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778987.628779:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663730560 00000100:00100000:3.0:1790778987.628793:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663730560 00000100:00100000:3.0:1790778987.628845:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790778987.628856:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663730560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778987.628921:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790778987.628977:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663730560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.628985:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1790778987.629024:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d3b80 x1877767663730560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778987.629044:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663730560:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790778987.630201:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603990700 x1877767663729920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778987.630215:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663729920:0@lo:400:kworker.0 00010000:00080000:2.0:1790778987.630236:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603993b80 x1877767663730432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778987.630243:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663730432:0@lo:400:kworker.0 00000100:00100000:2.0:1790778987.630252:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663728896:0@lo:400:kworker.0 00000100:00100000:2.0:1790778987.630277:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663729408:0@lo:400:kworker.0 00000100:00100000:0.0:1790778987.630501:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663730688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790778987.630553:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778987.630619:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663729152:0@lo:400:kworker.0 00010000:00080000:2.0:1790778987.630634:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603991c00 x1877767663729664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778987.630643:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663729664:0@lo:400:kworker.0 00010000:00080000:2.0:1790778987.630654:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603993800 x1877767663730176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778987.630663:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663730176:0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.630666:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663730688 00000100:00100000:3.0:1790778987.630673:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663730688 00000100:00100000:2.0:1790778987.630676:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663729024:0@lo:400:kworker.0 00000100:00100000:2.0:1790778987.630689:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663729536:0@lo:400:kworker.0 00000100:00100000:2.0:1790778987.630701:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663730048:0@lo:400:kworker.0 00000100:00100000:3.0:1790778987.630726:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790778987.630736:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663730688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790778987.630755:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790778987.630799:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663730688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778987.630806:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1790778987.632639:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039bb800 x1877767663730688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778987.632663:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663730688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790778988.137652:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663730816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790778988.137839:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778988.138184:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663730816 00000100:00100000:2.0:1790778988.138193:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663730816 00000100:00100000:2.0:1790778988.138243:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790778988.138252:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663730816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790778988.138309:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790778988.138367:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663730816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778988.138386:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790778988.139866:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663730816:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790778988.462103:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778989.480074:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778990.186539:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778990.186560:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663730944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790778990.186627:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778990.186699:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663730944 00000100:00100000:3.0:1790778990.186706:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663730944 00000100:00100000:3.0:1790778990.186748:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790778990.186757:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663730944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790778990.186789:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790778990.186848:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663730944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778990.186856:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790778990.186936:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663730944:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790778990.506264:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778990.769974:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778990.770016:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778990.770043:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778990.770107:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642688000 00000100:00100000:3.0:1790778990.770116:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642688000 00000100:00100000:3.0:1790778990.770166:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642687872 00000100:00100000:3.0:1790778990.770169:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642687872 00000100:00100000:3.0:1790778990.770191:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:3.0:1790778990.770201:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642688000:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790778990.770221:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642687744 00000100:00100000:0.0:1790778990.770226:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642687744 00000100:00100000:0.0:1790778990.770269:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 287 00000100:00100000:3.0:1790778990.770283:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642688000:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 78us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778990.770283:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2398:x1877767642687744:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790778990.770298:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:3.0:1790778990.770318:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:3.0:1790778990.770325:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642687872:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790778990.770334:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2398:x1877767642687744:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 56us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778990.770343:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 287 00000100:00100000:3.0:1790778990.770356:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642687872:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778990.770364:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00080000:2.0:1790778990.772443:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790778990.772451:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1790778991.531255:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778991.720153:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663731072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778991.720220:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778991.720289:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790778991.720297:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663731200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790778991.720323:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778991.720375:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663731072 00000100:00100000:2.0:1790778991.720382:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663731072 00000100:00100000:2.0:1790778991.720428:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663731200 00000100:00100000:2.0:1790778991.720432:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663731200 00000100:00100000:2.0:1790778991.720450:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790778991.720457:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663731072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790778991.720485:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778991.720526:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663731072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778991.720533:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790778991.720547:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790778991.720553:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663731200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790778991.720562:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778991.720582:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663731200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778991.720588:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1790778991.720601:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790778991.720624:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d4000 x1877767663731200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778991.720649:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663731200:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1790778991.720662:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4c6d80 x1877767663731072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778991.720672:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663731072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790778992.553115:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778992.744174:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663731456:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.744242:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778992.744320:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663731968:0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.744339:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663731328:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.744352:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778992.744406:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663731456 00000100:00100000:1.0:1790778992.744415:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663731456 00000100:00100000:1.0:1790778992.744460:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663731968 00000100:00100000:1.0:1790778992.744463:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663731968 00000100:00100000:1.0:1790778992.744492:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790778992.744501:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663731456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.749977:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663732480:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.750054:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778992.750080:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663732992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778992.750104:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778992.750147:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663731584:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.750174:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778992.750192:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663732096:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.750212:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778992.750224:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663732608:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.750244:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778992.750257:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790778992.750263:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663731712:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.750297:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778992.750309:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663732224:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.750779:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778992.750806:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663732736:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.750831:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778992.750908:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663732480 00000100:00100000:3.0:1790778992.750916:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663732480 00000100:00100000:3.0:1790778992.750956:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663732096 00000100:00100000:3.0:1790778992.750959:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663732096 00000100:00100000:3.0:1790778992.750971:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663732608 00000100:00100000:3.0:1790778992.750974:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663732608 00000100:00100000:3.0:1790778992.750984:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663731712 00000100:00100000:3.0:1790778992.750987:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663731712 00000100:00100000:3.0:1790778992.751001:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790778992.751009:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663731968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.751077:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663731968:12345-0@lo:400:kworker.0 Request processed in 68us (6723us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778992.751085:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790778992.751105:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790778992.751111:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663732480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.751140:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663732480:12345-0@lo:400:kworker.0 Request processed in 29us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778992.751147:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790778992.751158:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790778992.751164:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663732096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.751176:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778992.752146:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663732096:12345-0@lo:400:kworker.0 Request processed in 976us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778992.752155:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790778992.752177:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790778992.752187:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663732608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.752238:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663732608:12345-0@lo:400:kworker.0 Request processed in 55us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778992.752243:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790778992.752255:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790778992.752261:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663731712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778992.753042:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663731456:12345-0@lo:400:kworker.0 Request processed in 8538us (8795us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778992.753051:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1790778992.753086:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790778992.753091:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778992.753464:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663731712:12345-0@lo:400:kworker.0 Request processed in 1202us (3165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778992.753472:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790778992.753541:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663732992 00000100:00100000:3.0:1790778992.753548:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663732992 00000100:00100000:3.0:1790778992.753605:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790778992.753613:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663732992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778992.753651:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790778992.753689:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663732992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (3584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778992.753695:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790778992.753716:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663731584 00000100:00100000:3.0:1790778992.753720:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663731584 00000100:00100000:3.0:1790778992.753744:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790778992.753751:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663731584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.753796:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663731840:0@lo:400:kworker.0 00000100:00080000:1.0:1790778992.755031:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778992.755122:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663731584:12345-0@lo:400:kworker.0 Request processed in 1368us (4944us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778992.755131:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790778992.755162:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663732224 00000100:00100000:3.0:1790778992.755168:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663732224 00000100:00100000:3.0:1790778992.755198:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663732736 00000100:00100000:3.0:1790778992.755202:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663732736 00000100:00100000:3.0:1790778992.755230:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790778992.755239:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663732224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.755250:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790778992.755957:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790778992.756181:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663732352:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.756184:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663732224:12345-0@lo:400:kworker.0 Request processed in 944us (5403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778992.756195:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790778992.756216:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790778992.756230:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663732736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.756232:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778992.756254:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663732864:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.756292:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663732736:12345-0@lo:400:kworker.0 Request processed in 67us (5458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778992.756300:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778992.756305:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790778992.756335:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663731328 00000100:00100000:0.0:1790778992.756341:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663731328 00000100:00100000:0.0:1790778992.756382:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1790778992.756389:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663731328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.756443:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663731328:12345-0@lo:400:kworker.0 Request processed in 54us (5276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778992.756456:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1790778992.756511:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663731840 00000100:00100000:0.0:1790778992.756516:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663731840 00000100:00100000:1.0:1790778992.756521:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663731328:0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.756538:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790778992.756545:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663731840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.756594:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663731840:12345-0@lo:400:kworker.0 Request processed in 49us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778992.756601:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790778992.756796:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663731840:0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.757190:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663732352 00000100:00100000:3.0:1790778992.757195:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663732352 00000100:00100000:3.0:1790778992.757211:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663732864 00000100:00100000:3.0:1790778992.757214:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663732864 00000100:00100000:3.0:1790778992.757225:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790778992.757231:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663732352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.757310:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790778992.757320:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663732864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778992.757414:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663732352:12345-0@lo:400:kworker.0 Request processed in 180us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778992.757415:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663732864:12345-0@lo:400:kworker.0 Request processed in 95us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778992.757428:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790778992.757435:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790778992.757644:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778992.757719:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663733120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790778992.757901:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778992.757944:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663733120 00000100:00100000:0.0:1790778992.757948:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663733120 00000100:00100000:0.0:1790778992.757975:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790778992.757985:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663733120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790778992.758000:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778992.758038:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663733120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778992.758813:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1790778992.758870:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603991500 x1877767663733120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778992.758925:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663733120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790778992.758968:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663731712:0@lo:400:kworker.0 00010000:00080000:0.0:1790778992.758982:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039b8e00 x1877767663732224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778992.758991:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663732224:0@lo:400:kworker.0 00010000:00080000:0.0:1790778992.759002:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039b8380 x1877767663732736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778992.759010:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663732736:0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.759023:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663731584:0@lo:400:kworker.0 00010000:00080000:0.0:1790778992.759034:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039b9500 x1877767663732096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778992.759172:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663732096:0@lo:400:kworker.0 00010000:00080000:0.0:1790778992.759191:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039ba300 x1877767663732608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778992.759199:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663732608:0@lo:400:kworker.0 00010000:00080000:0.0:1790778992.759234:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d3800 x1877767663732992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778992.759246:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663732992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778992.759257:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663731456:0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.759269:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663731968:0@lo:400:kworker.0 00000100:00100000:0.0:1790778992.759290:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663732480:0@lo:400:kworker.0 00010000:00080000:1.0:1790778992.762289:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039b8000 x1877767663732352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778992.762307:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663732352:0@lo:400:kworker.0 00010000:00080000:1.0:1790778992.762320:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039b9c00 x1877767663732864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778992.762338:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663732864:0@lo:400:kworker.0 00000100:00100000:2.0:1790778993.256130:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663733248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790778993.256202:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778993.256359:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663733248 00000100:00100000:3.0:1790778993.256368:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663733248 00000100:00100000:3.0:1790778993.256410:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790778993.256419:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663733248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790778993.256451:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790778993.256507:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663733248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778993.256514:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790778993.256581:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663733248:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790778993.577899:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778994.605056:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790778995.070172:0:11997:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:36:33 (1790778993) === 00000100:00100000:0.0:1790778995.304141:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790778995.304163:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663733376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790778995.304232:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778995.304696:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663733376 00000100:00100000:0.0:1790778995.304704:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663733376 00000100:00100000:0.0:1790778995.304758:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790778995.304767:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663733376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790778995.304803:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790778995.304864:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663733376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778995.304872:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790778995.304927:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663733376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790778995.471504:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778995.471639:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642688128 00000100:00100000:2.0:1790778995.471649:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642688128 00000100:00100000:2.0:1790778995.471714:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 289 00000100:00100000:2.0:1790778995.471724:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:8715:x1877767642688128:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790778995.471742:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778995.471759:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936cc51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b4256c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778995.471788:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936cc51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256c3 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778995.471799:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936cc51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256c3 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778995.471808:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3600, rc 0) 00000100:00100000:2.0:1790778995.471900:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8715:x1877767642688128:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 157us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778995.471923:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 289 00000100:00100000:2.0:1790778995.474031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778995.474162:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642688256 00000100:00100000:0.0:1790778995.474171:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642688256 00000100:00100000:0.0:1790778995.474218:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:0.0:1790778995.474227:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8715:x1877767642688256:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790778995.474396:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8715:x1877767642688256:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 168us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778995.474403:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:3.0:1790778995.476154:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778995.476225:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642688384 00000100:00100000:1.0:1790778995.476233:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642688384 00000100:00100000:1.0:1790778995.476281:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 291 00000100:00100000:1.0:1790778995.476291:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8715:x1877767642688384:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790778995.476422:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8715:x1877767642688384:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 132us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778995.476429:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 291 00000100:00100000:1.0:1790778995.478867:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778995.479037:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642688512 00000100:00100000:2.0:1790778995.479045:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642688512 00000100:00100000:2.0:1790778995.479093:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 292 00000100:00100000:2.0:1790778995.479102:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8719:x1877767642688512:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790778995.479465:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8719:x1877767642688512:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 362us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778995.479473:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 292 00000100:00100000:2.0:1790778995.513514:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778995.513940:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642688640 00000100:00100000:0.0:1790778995.513950:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642688640 00000100:00100000:0.0:1790778995.514023:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 293 00000100:00100000:0.0:1790778995.514035:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8719:x1877767642688640:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790778995.514195:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8719:x1877767642688640:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 163us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778995.514222:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 293 00000100:00100000:3.0:1790778995.518347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778995.518556:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642688768 00000100:00100000:2.0:1790778995.518566:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642688768 00000100:00100000:2.0:1790778995.518992:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 294 00000100:00100000:2.0:1790778995.519006:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8719:x1877767642688768:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790778995.520060:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8719:x1877767642688768:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 1052us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778995.520071:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 294 00000100:00100000:3.0:1790778995.525431:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778995.525502:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642688896 00000100:00100000:1.0:1790778995.525513:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642688896 00000100:00100000:1.0:1790778995.525573:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 295 00000100:00100000:1.0:1790778995.525584:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:8715:x1877767642688896:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790778995.525601:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778995.525618:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77055cee00/0xb1aa4014e936cc58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b4256f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778995.525645:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cee00/0xb1aa4014e936cc58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256f4 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778995.525672:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77055cee00/0xb1aa4014e936cc58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256f4 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778995.525866:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cee00, rc 0) 00000100:00100000:1.0:1790778995.526256:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:8715:x1877767642688896:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 673us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778995.526265:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 295 00000100:00100000:1.0:1790778995.530610:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778995.530731:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642689024 00000100:00100000:2.0:1790778995.530741:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642689024 00000100:00100000:2.0:1790778995.530912:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 296 00000100:00100000:2.0:1790778995.530923:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:8715:x1877767642689024:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790778995.530949:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790778995.530976:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790778995.530980:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790778995.530994:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790778995.531004:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790778995.531007:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1790778995.534131:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:8715:x1877767642689024:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 2800us (3119us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778995.534145:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 296 00000100:00100000:3.0:1790778995.541132:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778995.541581:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642689152 00000100:00100000:1.0:1790778995.541592:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642689152 00000100:00100000:1.0:1790778995.541650:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 297 00000100:00100000:1.0:1790778995.541660:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:8715:x1877767642689152:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790778995.541676:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778995.541693:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77055cfc00/0xb1aa4014e936cc5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b4256fb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778995.541720:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cfc00/0xb1aa4014e936cc5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256fb expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778995.541731:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77055cfc00/0xb1aa4014e936cc5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256fb expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778995.541740:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cfc00, rc 0) 00000100:00100000:1.0:1790778995.541921:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:8715:x1877767642689152:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 262us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778995.541929:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 297 00000100:00100000:1.0:1790778995.545158:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778995.548613:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642689280 00000100:00100000:2.0:1790778995.548682:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642689280 00000100:00100000:2.0:1790778995.548822:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 298 00000100:00100000:2.0:1790778995.548845:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:8715:x1877767642689280:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790778995.549049:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:8715:x1877767642689280:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 217us (3910us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778995.549058:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 298 00000100:00100000:3.0:1790778995.551669:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778995.552495:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642689408 00000100:00100000:0.0:1790778995.552505:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642689408 00000100:00100000:0.0:1790778995.552563:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 299 00000100:00100000:0.0:1790778995.552573:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:8715:x1877767642689408:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790778995.552721:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:8715:x1877767642689408:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 149us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778995.552729:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 299 00000100:00100000:3.0:1790778995.564075:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778995.564139:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642689536 00000100:00100000:0.0:1790778995.564160:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642689536 00000100:00100000:0.0:1790778995.564227:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 300 00000100:00100000:0.0:1790778995.564237:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:8721:x1877767642689536:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790778995.564682:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:8721:x1877767642689536:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 444us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778995.564691:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 300 00000100:00100000:1.0:1790778995.568870:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778995.569039:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642689664 00000100:00100000:0.0:1790778995.569050:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642689664 00000100:00100000:0.0:1790778995.569153:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 301 00000100:00100000:0.0:1790778995.569163:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:8721:x1877767642689664:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790778995.569324:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:8721:x1877767642689664:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 162us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778995.569332:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 301 00000100:00100000:3.0:1790778995.577443:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778995.577474:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778995.577561:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778995.581207:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790778995.581238:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642689792 00000100:00100000:2.0:1790778995.581246:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642689792 00000100:00100000:2.0:1790778995.581283:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642690048 00000100:00100000:2.0:1790778995.581286:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642690048 00000100:00100000:1.0:1790778995.581295:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642690432 00000100:00100000:1.0:1790778995.581300:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642690432 00000100:00100000:2.0:1790778995.581301:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:2.0:1790778995.581308:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1877767642689792:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790778995.581335:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b44070bd-520a-4282-a6d8-dd7e751e819e@192.168.203.3@tcp t0 exp 0000000000000000 cur 313 last 0 00000100:00100000:1.0:1790778995.581337:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:1.0:1790778995.581345:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642690432:12345-192.168.203.3@tcp:400:kworker.0 00000020:00000080:2.0:1790778995.581370:0:6524:0:(genops.c:1384:class_connect()) connect: client b44070bd-520a-4282-a6d8-dd7e751e819e, cookie 0xb1aa4014e936cc66 00000004:00100000:2.0:1790778995.581393:0:6524:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1790778995.581406:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642690432:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 63us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778995.581413:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:1.0:1790778995.581429:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1790778995.581433:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1877767642690048:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790778995.581446:0:10428:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from b44070bd-520a-4282-a6d8-dd7e751e819e@192.168.203.3@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:1.0:1790778995.581536:0:10428:0:(genops.c:1384:class_connect()) connect: client b44070bd-520a-4282-a6d8-dd7e751e819e, cookie 0xb1aa4014e936cc6d 00000004:00100000:1.0:1790778995.581549:0:10428:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790778995.581779:0:10428:0:(import.c:65:import_set_state_nolock()) ffff9b7601ded800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790778995.581970:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+6:2397:x1877767642690048:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 534us (4494us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778995.581978:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00080000:1.0:1790778995.581998:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790778995.582179:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9b760390e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790778995.582209:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+6:2397:x1877767642689792:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 901us (4776us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778995.582216:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1790778995.583190:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642690560 00000100:00100000:1.0:1790778995.583198:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642690560 00000100:00100000:1.0:1790778995.583385:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:1.0:1790778995.583395:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642690560:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790778995.583451:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642690560:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 58us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778995.583741:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00080000:2.0:1790778995.584554:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790778995.591080:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778995.591115:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778995.591141:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642690176 00000100:00100000:1.0:1790778995.591146:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778995.591151:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642690176 00000100:00080000:1.0:1790778995.591202:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790778995.591234:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642689920 00000100:00100000:1.0:1790778995.591235:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642690304 00000100:00100000:1.0:1790778995.591238:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642690304 00000100:00100000:0.0:1790778995.591238:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642689920 00000100:00100000:0.0:1790778995.591266:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:0.0:1790778995.591274:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+6:0:x1877767642690176:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790778995.591313:0:6523:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790778995.591336:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:0.0:1790778995.591518:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+6:0:x1877767642690176:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 243us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778995.591526:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:0.0:1790778995.591543:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:0.0:1790778995.591549:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+7:8715:x1877767642690304:12345-192.168.203.3@tcp:41:mount.lustre.0 00000100:00080000:1.0:1790778995.591554:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1790778995.591562:0:6523:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790778995.591782:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+7:8715:x1877767642690304:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 231us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778995.591789:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1790778995.592085:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+6:0:x1877767642689920:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790778995.592101:0:6524:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790778995.592130:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+6:0:x1877767642689920:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 781us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778995.592137:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1790778995.594870:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778995.595006:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642690688 00000100:00100000:0.0:1790778995.595016:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642690688 00000100:00100000:0.0:1790778995.595108:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:0.0:1790778995.595119:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+6:8715:x1877767642690688:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790778995.595212:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+6:8715:x1877767642690688:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778995.595220:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:1.0:1790778995.597824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778995.597872:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790778995.597931:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790778995.598003:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642690816 00000100:00100000:3.0:1790778995.598012:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642690816 00000100:00100000:3.0:1790778995.598052:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642690944 00000100:00100000:3.0:1790778995.598055:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642690944 00000100:00100000:3.0:1790778995.598072:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:3.0:1790778995.598080:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1877767642690816:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790778995.598111:0:8440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b44070bd-520a-4282-a6d8-dd7e751e819e@192.168.203.3@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:3.0:1790778995.598138:0:8440:0:(genops.c:1384:class_connect()) connect: client b44070bd-520a-4282-a6d8-dd7e751e819e, cookie 0xb1aa4014e936cc74 00002000:00100000:3.0:1790778995.598149:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b44070bd-520a-4282-a6d8-dd7e751e819e/ffff9b76038f5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790778995.598165:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790778995.598236:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790778995.598263:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9b76038f2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778995.598318:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+6:2397:x1877767642690816:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 237us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778995.598326:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:3.0:1790778995.598342:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1790778995.598347:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1877767642690944:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790778995.598362:0:8440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b44070bd-520a-4282-a6d8-dd7e751e819e@192.168.203.3@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:3.0:1790778995.598376:0:8440:0:(genops.c:1384:class_connect()) connect: client b44070bd-520a-4282-a6d8-dd7e751e819e, cookie 0xb1aa4014e936cc7b 00002000:00100000:3.0:1790778995.598381:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b44070bd-520a-4282-a6d8-dd7e751e819e/ffff9b76038f6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790778995.598392:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790778995.598425:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790778995.598437:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9b76038f6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778995.598459:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+6:2397:x1877767642690944:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 110us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778995.598482:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1790778995.598872:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642691072 00000100:00100000:2.0:1790778995.598907:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642691072 00000100:00100000:2.0:1790778995.598943:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:2.0:1790778995.598950:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b44070bd-520a-4282-a6d8-dd7e751e819e+6:8715:x1877767642691072:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:2.0:1790778995.599045:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b44070bd-520a-4282-a6d8-dd7e751e819e+6:8715:x1877767642691072:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 95us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778995.599053:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:1.0:1790778995.601460:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790778995.601497:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642691200 00000100:00100000:0.0:1790778995.601507:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642691200 00000100:00100000:0.0:1790778995.601566:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:0.0:1790778995.601576:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+6:8715:x1877767642691200:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790778995.601720:0:6526:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790778995.601799:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+6:8715:x1877767642691200:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 225us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778995.601816:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00010000:00010000:3.0:1790778995.625353:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778996.652257:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778996.840280:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663733504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790778996.840348:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778996.840350:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778996.840366:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663733632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778996.840404:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778996.840442:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663733504 00000100:00100000:0.0:1790778996.840449:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663733504 00000100:00100000:0.0:1790778996.840500:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663733632 00000100:00100000:0.0:1790778996.840503:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663733632 00000100:00100000:0.0:1790778996.840520:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790778996.840529:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663733504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790778996.840551:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790778996.840578:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790778996.840590:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663733632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790778996.840603:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790778996.840603:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663733504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778996.840614:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1790778996.840642:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778996.840652:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663733632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778996.840660:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1790778996.840667:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a8e00 x1877767663733632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778996.840686:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663733632:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1790778996.840716:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d4a80 x1877767663733504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778996.840727:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663733504:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790778997.673028:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778997.869372:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663733760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778997.869441:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778997.869514:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663733760 00000100:00100000:2.0:1790778997.869521:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663733760 00000100:00100000:2.0:1790778997.869572:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790778997.869582:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663733760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778997.869608:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790778997.869652:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663733760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778997.869659:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1790778997.869707:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d4a80 x1877767663733760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778997.869743:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663733760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778997.869764:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778997.869774:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663734144:0@lo:400:kworker.0 00000100:00080000:1.0:1790778997.869847:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790778997.869859:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663733888:0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.869908:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778997.869934:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663734400:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.869945:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778997.869983:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663734272:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.870011:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778997.870029:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663734784:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.870051:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778997.870070:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663735296:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.870089:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778997.870106:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790778997.870112:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663734656:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.870133:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778997.870148:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663735168:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.870167:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778997.870195:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663734144 00000100:00100000:2.0:1790778997.870199:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663734144 00000100:00100000:2.0:1790778997.870227:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790778997.870233:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663734144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.870271:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663734144:12345-0@lo:400:kworker.0 Request processed in 38us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778997.870276:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790778997.870293:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663734272 00000100:00100000:2.0:1790778997.870296:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663734272 00000100:00100000:2.0:1790778997.870419:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663734656 00000100:00100000:2.0:1790778997.870422:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663734656 00000100:00100000:2.0:1790778997.870439:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663735168 00000100:00100000:2.0:1790778997.870441:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663735168 00000100:00100000:2.0:1790778997.870452:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790778997.870457:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663734272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.870484:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663734272:12345-0@lo:400:kworker.0 Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778997.870489:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790778997.870498:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790778997.870503:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663734656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.870513:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663734016:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.870526:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663734656:12345-0@lo:400:kworker.0 Request processed in 22us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778997.870532:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790778997.870543:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790778997.870550:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663735168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.870556:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778997.870576:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663734528:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.870585:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663735168:12345-0@lo:400:kworker.0 Request processed in 36us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778997.870592:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790778997.870602:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663734016 00000100:00100000:2.0:1790778997.870605:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663734016 00000100:00100000:1.0:1790778997.870608:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778997.870624:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663734528 00000100:00100000:1.0:1790778997.870627:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663735040:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.870628:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663734528 00000100:00100000:2.0:1790778997.870650:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790778997.870656:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778997.870661:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663734016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.870689:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663733888 00000100:00100000:1.0:1790778997.870695:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663733888 00000100:00100000:2.0:1790778997.870702:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663734016:12345-0@lo:400:kworker.0 Request processed in 44us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778997.870721:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790778997.870735:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663735040 00000100:00100000:2.0:1790778997.870739:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663735040 00000100:00100000:1.0:1790778997.870744:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1790778997.870755:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663733888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.870762:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790778997.870771:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663734528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.870794:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663733888:12345-0@lo:400:kworker.0 Request processed in 42us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778997.870802:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1790778997.870822:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663734528:12345-0@lo:400:kworker.0 Request processed in 42us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778997.870842:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778997.870863:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663734912:0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.870908:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778997.870937:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663733888:0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.870959:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663734784 00000100:00100000:1.0:1790778997.870963:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663734784 00000100:00100000:1.0:1790778997.871567:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663735296 00000100:00100000:1.0:1790778997.871573:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663735296 00000100:00100000:1.0:1790778997.871592:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663734912 00000100:00100000:1.0:1790778997.871595:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663734912 00000100:00100000:1.0:1790778997.871607:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790778997.871613:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663734784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.871656:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663734784:12345-0@lo:400:kworker.0 Request processed in 41us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778997.871662:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790778997.871676:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790778997.871682:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663735296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.871709:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663735296:12345-0@lo:400:kworker.0 Request processed in 28us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778997.871715:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790778997.871727:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790778997.871733:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663734912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.871774:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663734912:12345-0@lo:400:kworker.0 Request processed in 42us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778997.871781:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1790778997.871800:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778997.871805:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790778997.871807:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790778997.872038:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663734016:0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.872050:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663734528:0@lo:400:kworker.0 00010000:00080000:1.0:1790778997.872093:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039bad80 x1877767663734912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778997.872103:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663734912:0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.872125:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663734400 00000100:00100000:1.0:1790778997.872207:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663734400 00000100:00100000:1.0:1790778997.872230:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790778997.872237:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663734400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.872278:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663734400:12345-0@lo:400:kworker.0 Request processed in 41us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778997.872286:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790778997.872385:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663734400:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.872936:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790778997.872959:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790778997.872969:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663735040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.873014:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663735040:12345-0@lo:400:kworker.0 Request processed in 48us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778997.873020:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:2.0:1790778997.873069:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039b8380 x1877767663734656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778997.873080:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663734656:0@lo:400:kworker.0 00010000:00080000:2.0:1790778997.873091:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039ba680 x1877767663735168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778997.873099:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663735168:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.873110:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663734272:0@lo:400:kworker.0 00010000:00080000:2.0:1790778997.873120:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039b8e00 x1877767663734784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778997.873127:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663734784:0@lo:400:kworker.0 00010000:00080000:2.0:1790778997.873148:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ec000 x1877767663735296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778997.873156:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663735296:0@lo:400:kworker.0 00000100:00100000:2.0:1790778997.873166:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663734144:0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.875298:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663735040:0@lo:400:kworker.0 00000100:00100000:1.0:1790778997.891433:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663735424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790778997.891576:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778997.891936:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663735424 00000100:00100000:1.0:1790778997.891945:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663735424 00000100:00100000:1.0:1790778997.893162:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790778997.893176:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663735424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790778997.893202:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790778997.893277:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663735424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778997.893286:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1790778997.893341:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603993b80 x1877767663735424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778997.893361:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663735424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790778998.379464:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663735552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790778998.379543:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778998.380082:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663735552 00000100:00100000:2.0:1790778998.380090:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663735552 00000100:00100000:2.0:1790778998.380142:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790778998.380151:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663735552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790778998.380183:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790778998.380236:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663735552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778998.380243:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790778998.380585:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663735552:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790778998.701426:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778999.721871:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779000.425062:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663735680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779000.425128:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779000.425242:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663735680 00000100:00100000:0.0:1790779000.425261:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663735680 00000100:00100000:0.0:1790779000.425323:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790779000.425334:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663735680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779000.425367:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790779000.425594:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663735680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 261us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779000.425602:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790779000.425678:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663735680:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1790779000.647227:0:12190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1790779000.745918:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790779000.937472:0:7455:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b44070bd-520a-4282-a6d8-dd7e751e819e 00000001:00100000:3.0:1790779000.941622:0:6502:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b44070bd-520a-4282-a6d8-dd7e751e819e 00000001:00100000:3.0:1790779000.946945:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b44070bd-520a-4282-a6d8-dd7e751e819e 00000001:00100000:1.0:1790779000.947030:0:9517:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b44070bd-520a-4282-a6d8-dd7e751e819e 00000100:00100000:1.0:1790779001.013518:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779001.013554:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779001.013595:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779001.013662:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779001.013681:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779001.013695:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779001.013727:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779001.013749:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642691968 00000100:00100000:3.0:1790779001.013910:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642691456 00000100:00100000:3.0:1790779001.013915:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642691456 00000100:00100000:3.0:1790779001.013966:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642691712 00000100:00100000:3.0:1790779001.013969:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642691712 00000100:00100000:3.0:1790779001.013983:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642691584 00000100:00100000:3.0:1790779001.013985:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642691584 00000100:00100000:3.0:1790779001.013995:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642691840 00000100:00100000:3.0:1790779001.013997:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642691840 00000100:00100000:3.0:1790779001.014012:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:3.0:1790779001.014021:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642691456:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779001.014096:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642691456:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 76us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779001.014104:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:3.0:1790779001.014129:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:3.0:1790779001.014135:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642691712:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779001.014161:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642691712:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779001.014166:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:3.0:1790779001.014176:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:3.0:1790779001.014182:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642691584:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779001.014200:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642691584:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 19us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779001.014205:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:3.0:1790779001.014214:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:3.0:1790779001.014220:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642691840:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779001.014239:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642691840:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779001.014244:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00080000:3.0:1790779001.014258:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779001.014262:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779001.014823:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642692096 00000100:00100000:3.0:1790779001.014830:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642692096 00000100:00100000:3.0:1790779001.014875:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00080000:2.0:1790779001.014876:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779001.014927:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642691968 00000100:00100000:0.0:1790779001.017068:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642691328 00000100:00100000:0.0:1790779001.017082:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642691328 00000100:00100000:0.0:1790779001.017248:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 303 00000100:00100000:0.0:1790779001.017258:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642691328:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779001.018508:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642691328:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1245us (4904us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779001.018519:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 303 00000100:00080000:0.0:1790779001.019211:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779001.020054:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642692096:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779001.020135:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642692096:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 93us (6406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779001.029011:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:1.0:1790779001.029033:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642691968:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779001.029128:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642691968:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 105us (15465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779001.029137:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:3.0:1790779001.033154:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00010000:00010000:1.0:1790779001.775052:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779001.962465:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779001.962489:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663735808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779001.962562:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779001.962620:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663735808 00000100:00100000:1.0:1790779001.962627:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663735808 00000100:00100000:1.0:1790779001.962680:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790779001.962689:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663735808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779001.962926:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779001.963050:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663735808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 362us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779001.963058:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1790779001.963083:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790779001.963114:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a9180 x1877767663735808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779001.963133:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663735808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779001.963491:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779001.963501:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663735936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779001.963534:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779001.963570:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663735936 00000100:00100000:2.0:1790779001.963575:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663735936 00000100:00100000:2.0:1790779001.963609:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790779001.963616:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663735936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790779001.963628:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779001.963659:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663735936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779001.963665:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1790779001.963690:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603747480 x1877767663735936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779001.963722:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663735936:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790779001.963739:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790779002.795638:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779002.984656:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663736192:0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.984724:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779002.984787:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663736704:0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.984812:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779002.984839:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663737216:0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.984860:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779002.984918:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790779002.984925:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663736320:0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.984951:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779002.984971:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663736832:0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.984993:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779002.985025:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663737344:0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.985052:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779002.985093:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663736192 00000100:00100000:0.0:1790779002.985100:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663736192 00000100:00100000:0.0:1790779002.985135:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663736704 00000100:00100000:0.0:1790779002.985138:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663736704 00000100:00100000:0.0:1790779002.985161:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663737216 00000100:00100000:0.0:1790779002.985164:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663737216 00000100:00100000:0.0:1790779002.985178:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663736832 00000100:00100000:0.0:1790779002.985181:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663736832 00000100:00100000:0.0:1790779002.985192:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663737344 00000100:00100000:0.0:1790779002.985194:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663737344 00000100:00100000:0.0:1790779002.985208:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790779002.985215:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663736192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.985267:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663736192:12345-0@lo:400:kworker.0 Request processed in 51us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779002.985275:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790779002.985290:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790779002.985297:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663736704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.985326:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663736704:12345-0@lo:400:kworker.0 Request processed in 30us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779002.985331:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790779002.985342:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790779002.985355:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663737216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.985380:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663737216:12345-0@lo:400:kworker.0 Request processed in 33us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779002.985386:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790779002.985398:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790779002.985412:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663736832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.985441:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663736832:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779002.985447:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790779002.985458:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790779002.985464:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663737344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.985490:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663737344:12345-0@lo:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779002.985495:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790779002.985519:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663736320 00000100:00100000:0.0:1790779002.985523:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663736320 00000100:00100000:0.0:1790779002.985545:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790779002.985551:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663736320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.985582:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663736320:12345-0@lo:400:kworker.0 Request processed in 31us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779002.985588:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1790779002.985605:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790779002.985609:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779002.985634:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663736320:0@lo:400:kworker.0 00010000:00080000:0.0:1790779002.985646:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7aad80 x1877767663736832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779002.985655:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663736832:0@lo:400:kworker.0 00010000:00080000:0.0:1790779002.985664:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b76aa00 x1877767663737344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779002.985670:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663737344:0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.985687:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663736192:0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.985695:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663736704:0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.985702:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663737216:0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.986897:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663736064:0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.986955:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779002.986989:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663736576:0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.987013:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779002.987029:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663737088:0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.987051:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779002.987070:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663737600:0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.987090:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779002.987111:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790779002.987117:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663736448:0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.987137:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779002.987152:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663736960:0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.987173:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779002.987189:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663737472:0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.987206:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779002.987242:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663737088 00000100:00100000:2.0:1790779002.987248:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663737088 00000100:00100000:2.0:1790779002.987275:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663737600 00000100:00100000:2.0:1790779002.987278:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663737600 00000100:00100000:2.0:1790779002.987293:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663736960 00000100:00100000:2.0:1790779002.987296:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663736960 00000100:00100000:2.0:1790779002.987305:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663737472 00000100:00100000:2.0:1790779002.987307:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663737472 00000100:00100000:2.0:1790779002.987337:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790779002.987343:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663737088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.987390:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663737088:12345-0@lo:400:kworker.0 Request processed in 47us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779002.987397:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790779002.987410:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790779002.987417:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663737600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.987442:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663737600:12345-0@lo:400:kworker.0 Request processed in 27us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779002.987447:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790779002.987457:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790779002.987462:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663736960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.987485:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663736960:12345-0@lo:400:kworker.0 Request processed in 23us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779002.987490:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790779002.987501:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790779002.987507:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663737472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779002.987531:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663737472:12345-0@lo:400:kworker.0 Request processed in 24us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779002.987536:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1790779002.987568:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a8380 x1877767663736960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779002.987580:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663736960:0@lo:400:kworker.0 00010000:00080000:2.0:1790779002.987590:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b76b800 x1877767663737472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779002.987610:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663737472:0@lo:400:kworker.0 00010000:00080000:2.0:1790779002.987622:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7aaa00 x1877767663737088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779002.987629:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663737088:0@lo:400:kworker.0 00010000:00080000:2.0:1790779002.987638:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b76b100 x1877767663737600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779002.987646:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663737600:0@lo:400:kworker.0 00000100:00100000:1.0:1790779002.988017:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663736064 00000100:00100000:1.0:1790779002.988028:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663736064 00000100:00100000:3.0:1790779002.988067:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1790779002.988082:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663736064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779002.988123:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663736064:12345-0@lo:400:kworker.0 Request processed in 44us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779002.988170:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663736064:0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.988268:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663737856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779002.988299:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779002.988330:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790779002.988336:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663737728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779002.988357:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779002.988385:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663737856 00000100:00100000:0.0:1790779002.988389:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663737856 00000100:00100000:0.0:1790779002.988414:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663737728 00000100:00100000:0.0:1790779002.988417:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663737728 00000100:00100000:0.0:1790779002.988429:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790779002.988435:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663737856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779002.988457:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779002.988499:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790779002.988506:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663737728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790779002.988516:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779002.988549:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663737728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779002.988555:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790779002.988669:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663737856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 233us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779002.988675:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1790779002.988695:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779002.988706:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663736576 00000100:00100000:0.0:1790779002.988710:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663736576 00000100:00100000:0.0:1790779002.988741:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790779002.988748:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663736576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.988799:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663736576:12345-0@lo:400:kworker.0 Request processed in 51us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779002.988816:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:0.0:1790779002.988967:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041a4700 x1877767663737728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779002.988982:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663737728:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1790779002.988993:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c0df80 x1877767663737856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779002.989002:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663737856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779002.989026:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663736448 00000100:00100000:0.0:1790779002.989030:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663736448 00000100:00100000:0.0:1790779002.989375:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790779002.989383:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663736448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.989424:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663736448:12345-0@lo:400:kworker.0 Request processed in 41us (2283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779002.989430:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790779002.989462:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663736448:0@lo:400:kworker.0 00000100:00100000:0.0:1790779002.989474:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663736576:0@lo:400:kworker.0 00000100:00100000:3.0:1790779002.994173:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1790779003.500381:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790779003.500403:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663737984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779003.500469:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779003.500538:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663737984 00000100:00100000:0.0:1790779003.500545:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663737984 00000100:00100000:0.0:1790779003.500584:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790779003.500592:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663737984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779003.500622:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790779003.500675:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663737984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779003.500682:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790779003.500742:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663737984:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790779003.817130:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779004.845493:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779005.544157:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779005.544180:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663738112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779005.544245:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779005.544352:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663738112 00000100:00100000:0.0:1790779005.544360:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663738112 00000100:00100000:0.0:1790779005.544409:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790779005.544419:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663738112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779005.544451:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790779005.544515:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663738112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779005.544522:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790779005.544682:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663738112:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790779005.864103:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779006.130415:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779006.130453:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779006.130476:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779006.130501:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779006.130520:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779006.130553:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779006.130579:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779006.130686:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642692352 00000100:00100000:3.0:1790779006.130697:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642692352 00000100:00100000:3.0:1790779006.130746:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642692608 00000100:00100000:3.0:1790779006.130760:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642692608 00000100:00100000:3.0:1790779006.130775:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642692480 00000100:00100000:3.0:1790779006.130779:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642692480 00000100:00100000:3.0:1790779006.130788:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642692736 00000100:00100000:3.0:1790779006.130790:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642692736 00000100:00100000:3.0:1790779006.130804:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:3.0:1790779006.130812:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2399:x1877767642692352:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779006.130905:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2399:x1877767642692352:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 92us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779006.130913:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:3.0:1790779006.130929:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:3.0:1790779006.130935:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642692608:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779006.130971:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642692608:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 35us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779006.130977:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:3.0:1790779006.130989:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:3.0:1790779006.130994:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642692480:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779006.131016:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642692480:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779006.131022:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:3.0:1790779006.131032:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:3.0:1790779006.131038:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642692736:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779006.131060:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642692736:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779006.131067:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:3.0:1790779006.131084:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642692224 00000100:00100000:3.0:1790779006.131087:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642692224 00000100:00100000:3.0:1790779006.131111:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 305 00000100:00100000:3.0:1790779006.131117:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642692224:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779006.131141:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642692224:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779006.131148:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 305 00000100:00080000:3.0:1790779006.131171:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779006.131175:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779006.133059:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642692864 00000100:00100000:3.0:1790779006.133070:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642692864 00000100:00100000:3.0:1790779006.133116:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642692992 00000100:00100000:3.0:1790779006.133126:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642692992 00000100:00100000:3.0:1790779006.133158:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:3.0:1790779006.133167:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642692864:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779006.133607:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:2.0:1790779006.133620:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642692992:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779006.133700:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642692992:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 84us (3119us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779006.133709:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00080000:2.0:1790779006.133864:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790779006.133869:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779006.134312:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642692864:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1142us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779006.134320:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00010000:00010000:1.0:1790779006.888082:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779007.080438:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779007.080460:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663738240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779007.080543:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779007.081449:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663738240 00000100:00100000:2.0:1790779007.081460:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663738240 00000100:00100000:2.0:1790779007.081528:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790779007.081538:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663738240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790779007.081569:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779007.081635:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663738240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779007.081643:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1790779007.081687:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041a4000 x1877767663738240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779007.081704:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663738240:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790779007.083108:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779007.083614:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663738368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779007.083678:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779007.084097:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663738368 00000100:00100000:0.0:1790779007.084106:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663738368 00000100:00100000:0.0:1790779007.084165:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790779007.084174:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663738368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779007.084211:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779007.084276:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663738368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779007.084283:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1790779007.084416:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b76b800 x1877767663738368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779007.084435:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663738368:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790779007.085177:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:3.0:1790779007.542117:0:12506:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790779007.542571:0:12506:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779007.914703:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779008.106047:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663738496:0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106125:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779008.106171:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663739008:0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106197:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779008.106230:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663739520:0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106254:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779008.106298:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663740032:0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106321:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779008.106346:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1790779008.106353:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663738624:0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106376:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779008.106395:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663739136:0@lo:400:kworker.0 00000100:00100000:3.0:1790779008.106414:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663739008 00000100:00100000:0.0:1790779008.106414:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779008.106422:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663739008 00000100:00100000:0.0:1790779008.106429:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663739648:0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106445:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779008.106460:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663740160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779008.106463:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790779008.106471:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663739008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106479:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779008.106502:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663738752:0@lo:400:kworker.0 00000100:00100000:3.0:1790779008.106528:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663739008:12345-0@lo:400:kworker.0 Request processed in 57us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779008.106536:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790779008.106536:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779008.106547:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663739264:0@lo:400:kworker.0 00000100:00100000:3.0:1790779008.106551:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663738752 00000100:00100000:3.0:1790779008.106553:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663738752 00000100:00100000:0.0:1790779008.106566:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779008.106567:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790779008.106572:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663738752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106581:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663739776:0@lo:400:kworker.0 00000100:00100000:3.0:1790779008.106600:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663738752:12345-0@lo:400:kworker.0 Request processed in 28us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779008.106600:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779008.106606:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790779008.106624:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663738624 00000100:00100000:0.0:1790779008.106625:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663738752:0@lo:400:kworker.0 00000100:00100000:3.0:1790779008.106627:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663738624 00000100:00100000:0.0:1790779008.106638:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790779008.106643:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663739136 00000100:00100000:0.0:1790779008.106643:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663738880:0@lo:400:kworker.0 00000100:00100000:3.0:1790779008.106645:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663739136 00000100:00100000:0.0:1790779008.106664:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779008.106674:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663739648 00000100:00100000:0.0:1790779008.106676:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663739392:0@lo:400:kworker.0 00000100:00100000:3.0:1790779008.106677:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663739648 00000100:00100000:3.0:1790779008.106688:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663739264 00000100:00100000:3.0:1790779008.106690:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663739264 00000100:00100000:0.0:1790779008.106694:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779008.106700:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663739776 00000100:00100000:3.0:1790779008.106702:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663739776 00000100:00100000:0.0:1790779008.106710:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663739904:0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106750:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779008.106780:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663738880 00000100:00100000:0.0:1790779008.106784:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663738880 00000100:00100000:0.0:1790779008.106802:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790779008.106808:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663738624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106839:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663738624:12345-0@lo:400:kworker.0 Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779008.106845:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790779008.106850:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663738496 00000100:00100000:2.0:1790779008.106854:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663738496 00000100:00100000:0.0:1790779008.106856:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790779008.106861:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663739136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779008.106894:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1790779008.106905:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663739136:12345-0@lo:400:kworker.0 Request processed in 43us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779008.106911:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790779008.106922:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790779008.106928:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663739648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106955:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663739648:12345-0@lo:400:kworker.0 Request processed in 27us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779008.106960:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790779008.106971:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663738496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.106971:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790779008.106976:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663739264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779008.107001:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663738496:12345-0@lo:400:kworker.0 Request processed in 33us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779008.107001:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663739264:12345-0@lo:400:kworker.0 Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779008.107006:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790779008.107007:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1790779008.107016:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790779008.107021:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663738880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779008.107032:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663739520 00000100:00100000:2.0:1790779008.107035:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663739520 00000100:00100000:2.0:1790779008.107050:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663740032 00000100:00100000:0.0:1790779008.107057:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663738880:12345-0@lo:400:kworker.0 Request processed in 36us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779008.107058:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663740032 00000100:00100000:0.0:1790779008.107063:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790779008.107072:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663739392 00000100:00100000:2.0:1790779008.107074:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663739392 00000100:00100000:2.0:1790779008.107084:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663739904 00000100:00100000:2.0:1790779008.107086:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663739904 00000100:00100000:0.0:1790779008.107086:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663740160 00000100:00100000:0.0:1790779008.107088:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663740160 00000100:00100000:2.0:1790779008.107099:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790779008.107104:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663739520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.107106:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790779008.107111:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663740160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779008.107131:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779008.107132:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663739520:12345-0@lo:400:kworker.0 Request processed in 29us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779008.107137:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790779008.107148:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790779008.107153:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663740032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.107156:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663740160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779008.107161:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790779008.107178:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790779008.107185:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663739392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.107212:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663739392:12345-0@lo:400:kworker.0 Request processed in 28us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779008.107218:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790779008.107229:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790779008.107235:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663739904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.107261:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663739904:12345-0@lo:400:kworker.0 Request processed in 26us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779008.107266:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790779008.107275:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790779008.107280:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663739776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.107305:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663738624:0@lo:400:kworker.0 00000100:00100000:3.0:1790779008.107309:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663739776:12345-0@lo:400:kworker.0 Request processed in 30us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779008.107314:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663739136:0@lo:400:kworker.0 00000100:00100000:3.0:1790779008.107315:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790779008.107323:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663739648:0@lo:400:kworker.0 00000100:00080000:3.0:1790779008.107330:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790779008.107334:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779008.107336:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790779008.107343:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a3d180 x1877767663740160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779008.107358:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663740160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779008.107367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663738496:0@lo:400:kworker.0 00000100:00100000:0.0:1790779008.107375:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663739008:0@lo:400:kworker.0 00010000:00080000:0.0:1790779008.107391:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a8700 x1877767663739520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779008.107399:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663739520:0@lo:400:kworker.0 00000100:00100000:2.0:1790779008.107467:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663740032:12345-0@lo:400:kworker.0 Request processed in 312us (1143us total) trans 0 rc 0/0 00010000:00080000:0.0:1790779008.107472:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603911180 x1877767663740032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779008.107474:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790779008.107480:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663740032:0@lo:400:kworker.0 00000100:00100000:2.0:1790779008.107496:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779008.107504:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663740288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779008.107532:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779008.107568:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663738880:0@lo:400:kworker.0 00010000:00080000:2.0:1790779008.107578:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a8a80 x1877767663739392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779008.107587:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663739392:0@lo:400:kworker.0 00010000:00080000:2.0:1790779008.107596:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7ab100 x1877767663739904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779008.107603:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663739904:0@lo:400:kworker.0 00010000:00080000:2.0:1790779008.107610:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a8380 x1877767663739264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779008.107625:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663739264:0@lo:400:kworker.0 00010000:00080000:2.0:1790779008.107635:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7aad80 x1877767663739776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779008.107643:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663739776:0@lo:400:kworker.0 00000100:00100000:3.0:1790779008.107797:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663740288 00000100:00100000:3.0:1790779008.107802:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663740288 00000100:00100000:3.0:1790779008.107832:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790779008.107839:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663740288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779008.107849:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779008.108076:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663740288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 236us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779008.108083:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1790779008.108151:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041a4a80 x1877767663740288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779008.108237:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663740288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779008.621330:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779008.622020:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663740416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779008.622086:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779008.622419:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663740416 00000100:00100000:3.0:1790779008.622428:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663740416 00000100:00100000:3.0:1790779008.622727:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790779008.622749:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663740416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779008.622779:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790779008.623518:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663740416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 769us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779008.623544:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790779008.623729:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663740416:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790779008.936062:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790779009.404033:0:12603:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790779009.404338:0:12603:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779009.960072:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779010.664317:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663740544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779010.664393:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779010.664511:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663740544 00000100:00100000:1.0:1790779010.664520:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663740544 00000100:00100000:1.0:1790779010.664573:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790779010.664582:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663740544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779010.664614:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790779010.664662:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663740544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779010.664669:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790779010.664726:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663740544:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790779010.991907:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779011.251552:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779011.251999:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642693120 00000100:00100000:2.0:1790779011.252017:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642693120 00000100:00100000:2.0:1790779011.252078:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 307 00000100:00100000:2.0:1790779011.252095:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642693120:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779011.252174:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642693120:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 81us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779011.252181:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 307 00000100:00100000:2.0:1790779011.253504:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779011.253866:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642693248 00000100:00100000:1.0:1790779011.253903:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642693248 00000100:00100000:1.0:1790779011.253960:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:1.0:1790779011.253971:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642693248:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779011.254046:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642693248:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 77us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779011.254054:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00080000:3.0:1790779011.254630:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779011.258082:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779011.258272:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642693376 00000100:00100000:1.0:1790779011.258281:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642693376 00000100:00100000:1.0:1790779011.258347:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:1.0:1790779011.258358:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642693376:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779011.258427:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642693376:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 72us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779011.258434:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00080000:3.0:1790779011.258576:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779011.263576:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779011.263645:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779011.263728:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642693888 00000100:00100000:3.0:1790779011.263738:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642693888 00000100:00100000:3.0:1790779011.263801:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:3.0:1790779011.263811:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642693888:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779011.263912:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642693888:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 102us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779011.263920:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00080000:1.0:1790779011.264403:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779011.265384:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642693632 00000100:00100000:1.0:1790779011.265394:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642693632 00000100:00100000:1.0:1790779011.265461:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 153 00000100:00100000:1.0:1790779011.265470:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642693632:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779011.265531:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642693632:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 62us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779011.265538:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 153 00000100:00080000:3.0:1790779011.265982:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779011.272506:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779011.272583:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779011.272625:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642693760 00000100:00100000:1.0:1790779011.272636:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642693760 00000100:00100000:1.0:1790779011.272696:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:1.0:1790779011.272707:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642693760:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779011.272792:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642693760:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 88us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779011.272800:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00080000:2.0:1790779011.273737:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779011.274599:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642693504 00000100:00100000:3.0:1790779011.274608:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642693504 00000100:00100000:3.0:1790779011.274656:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 154 00000100:00100000:3.0:1790779011.274663:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642693504:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779011.274727:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642693504:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 63us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779011.274733:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 154 00000100:00080000:3.0:1790779011.274755:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:2.0:1790779011.319351:0:12700:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779011.319564:0:12700:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779012.008745:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779012.200146:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663740672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779012.200233:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779012.200915:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663740672 00000100:00100000:0.0:1790779012.200926:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663740672 00000100:00100000:0.0:1790779012.200990:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790779012.201001:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663740672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779012.201028:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779012.201083:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663740672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779012.201090:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1790779012.201381:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041a5880 x1877767663740672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779012.201402:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663740672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779012.201644:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779012.201656:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663740800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779012.201692:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779012.201760:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663740800 00000100:00100000:2.0:1790779012.201764:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663740800 00000100:00100000:2.0:1790779012.201795:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790779012.201802:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663740800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790779012.201818:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779012.201852:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663740800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779012.201858:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1790779012.201910:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041a5c00 x1877767663740800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779012.201924:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663740800:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790779012.202797:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790779013.032193:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779013.225873:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779013.225911:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663740928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779013.225993:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779013.226059:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663740928 00000100:00100000:3.0:1790779013.226067:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663740928 00000100:00100000:3.0:1790779013.226114:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790779013.226124:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663740928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779013.226153:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779013.226197:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663740928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779013.226205:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1790779013.226383:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790779013.226413:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a3ea00 x1877767663740928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779013.226431:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663740928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779013.226631:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663741056:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.226667:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.226716:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663741568:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.226749:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.226771:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663742080:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.226793:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.226812:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790779013.226818:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663741184:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.226842:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.226861:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663741696:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.226901:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.226920:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663742208:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.226940:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.226966:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663741440:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.226988:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.227003:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663741952:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227023:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.227039:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663742464:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227058:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.227079:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790779013.227083:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663741312:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227103:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.227120:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663741824:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227139:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.227149:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663742336:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227166:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779013.227187:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663741056 00000100:00100000:0.0:1790779013.227200:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663741056 00000100:00100000:0.0:1790779013.227233:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1790779013.227240:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663741056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227280:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663741056:12345-0@lo:400:kworker.0 Request processed in 40us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.227287:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1790779013.227315:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663741568 00000100:00100000:0.0:1790779013.227319:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663741568 00000100:00100000:0.0:1790779013.227335:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663741312 00000100:00100000:0.0:1790779013.227338:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663741312 00000100:00100000:0.0:1790779013.227349:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790779013.227354:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663741568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227386:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663741568:12345-0@lo:400:kworker.0 Request processed in 32us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.227392:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790779013.227402:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790779013.227407:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663741312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227438:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663741312:12345-0@lo:400:kworker.0 Request processed in 31us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.227444:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790779013.227461:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663741184 00000100:00100000:0.0:1790779013.227464:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663741184 00000100:00100000:0.0:1790779013.227479:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663741696 00000100:00100000:0.0:1790779013.227481:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663741696 00000100:00100000:0.0:1790779013.227495:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663742208 00000100:00100000:0.0:1790779013.227497:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663742208 00000100:00100000:0.0:1790779013.227506:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663741440 00000100:00100000:0.0:1790779013.227509:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663741440 00000100:00100000:0.0:1790779013.227518:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663741824 00000100:00100000:0.0:1790779013.227526:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663741824 00000100:00100000:0.0:1790779013.227541:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663742336 00000100:00100000:0.0:1790779013.227543:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663742336 00000100:00100000:0.0:1790779013.227556:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790779013.227562:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663741184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227594:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663741184:12345-0@lo:400:kworker.0 Request processed in 31us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.227600:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790779013.227613:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790779013.227619:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663741696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227645:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663741696:12345-0@lo:400:kworker.0 Request processed in 27us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.227652:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790779013.227663:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790779013.227669:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663742208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227695:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663742208:12345-0@lo:400:kworker.0 Request processed in 27us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.227712:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790779013.227724:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790779013.227729:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663741440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227755:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663741440:12345-0@lo:400:kworker.0 Request processed in 27us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.227761:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790779013.227771:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790779013.227777:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663741824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227801:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663741824:12345-0@lo:400:kworker.0 Request processed in 25us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.227813:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790779013.227824:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790779013.227830:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663742336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227857:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663742336:12345-0@lo:400:kworker.0 Request processed in 27us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.227862:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790779013.227903:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663742080 00000100:00100000:0.0:1790779013.227907:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663742080 00000100:00100000:0.0:1790779013.227931:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663741952 00000100:00100000:0.0:1790779013.227934:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663741952 00000100:00100000:0.0:1790779013.227944:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663742464 00000100:00100000:0.0:1790779013.227946:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663742464 00000100:00100000:0.0:1790779013.227960:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790779013.227965:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663742080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.227995:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663742080:12345-0@lo:400:kworker.0 Request processed in 30us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.228001:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790779013.228011:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790779013.228016:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663741952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.228040:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663741952:12345-0@lo:400:kworker.0 Request processed in 24us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.228045:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790779013.228055:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790779013.228060:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663742464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.228083:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663742464:12345-0@lo:400:kworker.0 Request processed in 24us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779013.228098:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790779013.228139:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663741312:0@lo:400:kworker.0 00010000:00080000:0.0:1790779013.228151:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603831880 x1877767663741824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779013.228160:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663741824:0@lo:400:kworker.0 00010000:00080000:0.0:1790779013.228170:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603911f80 x1877767663742336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779013.228177:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663742336:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.228186:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663741440:0@lo:400:kworker.0 00010000:00080000:0.0:1790779013.228195:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603910a80 x1877767663741952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779013.228202:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663741952:0@lo:400:kworker.0 00010000:00080000:0.0:1790779013.228209:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603913800 x1877767663742464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779013.228216:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663742464:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.228251:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663741184:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.228260:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663741696:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.228268:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663742208:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.228276:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663741056:0@lo:400:kworker.0 00000100:00100000:0.0:1790779013.228285:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663741568:0@lo:400:kworker.0 00010000:00080000:0.0:1790779013.228304:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603913480 x1877767663742080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779013.228312:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663742080:0@lo:400:kworker.0 00000100:00100000:3.0:1790779013.228532:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790779013.228542:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663742592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779013.228574:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779013.228605:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663742592 00000100:00100000:3.0:1790779013.228609:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663742592 00000100:00100000:3.0:1790779013.228636:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790779013.228642:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663742592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790779013.228656:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779013.228761:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663742592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779013.228768:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1790779013.228788:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790779013.228793:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779013.228802:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790779013.228822:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a3ea00 x1877767663742592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779013.228837:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663742592:0@lo:13:osp-pre-1-0.0 00000020:00000004:1.0:1790779013.549427:0:12798:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779013.552093:0:12798:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790779013.736247:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779013.736272:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663742720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779013.736341:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779013.736459:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663742720 00000100:00100000:3.0:1790779013.736469:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663742720 00000100:00100000:3.0:1790779013.736521:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790779013.736530:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663742720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779013.736562:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790779013.736609:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663742720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779013.736616:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790779013.736721:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663742720:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790779014.060868:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779015.080113:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790779015.618121:0:12895:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779015.618448:0:12895:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790779015.783986:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663742848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779015.784049:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779015.784117:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663742848 00000100:00100000:1.0:1790779015.784125:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663742848 00000100:00100000:1.0:1790779015.784163:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790779015.784177:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663742848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779015.784208:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790779015.784249:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663742848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779015.784271:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790779015.786910:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663742848:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790779016.104094:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779016.375864:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779016.377491:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779016.377514:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779016.377544:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779016.377568:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779016.377612:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642694144 00000100:00100000:1.0:1790779016.377622:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642694144 00000100:00100000:1.0:1790779016.377683:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642694400 00000100:00100000:1.0:1790779016.377687:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642694400 00000100:00100000:1.0:1790779016.377713:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:1.0:1790779016.377723:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642694144:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779016.377796:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642694144:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 74us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779016.377803:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:1.0:1790779016.377820:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00100000:1.0:1790779016.377827:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642694400:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779016.377852:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642694400:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779016.377859:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00100000:1.0:1790779016.377909:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642694656 00000100:00100000:1.0:1790779016.377913:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642694656 00000100:00100000:1.0:1790779016.377937:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642694784 00000100:00100000:1.0:1790779016.377940:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642694784 00000100:00100000:1.0:1790779016.377972:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:1.0:1790779016.377978:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2397:x1877767642694656:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:1.0:1790779016.377997:0:8855:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cc74 00000100:00080000:1.0:1790779016.378006:0:8855:0:(import.c:65:import_set_state_nolock()) ffff9b76038f2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790779016.378045:0:8855:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1790779016.378176:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+2:2397:x1877767642694656:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 197us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779016.378183:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:1.0:1790779016.378195:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:1.0:1790779016.378202:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2397:x1877767642694784:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:1.0:1790779016.378212:0:8855:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cc7b 00000100:00080000:1.0:1790779016.378218:0:8855:0:(import.c:65:import_set_state_nolock()) ffff9b76038f6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790779016.378238:0:8855:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1790779016.378906:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779016.379046:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+2:2397:x1877767642694784:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 104us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779016.379055:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00080000:1.0:1790779016.379079:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790779016.379084:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790779016.379087:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779016.379096:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642694272 00000100:00100000:1.0:1790779016.379101:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642694272 00000100:00100000:1.0:1790779016.379131:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 163 00000100:00100000:1.0:1790779016.379139:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642694272:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779016.379703:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642694272:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 563us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779016.379711:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 163 00010000:00010000:1.0:1790779016.379743:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779016.379748:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790779016.379753:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790779016.379795:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779016.379945:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642694528 00000100:00100000:0.0:1790779016.379951:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642694528 00000100:00100000:0.0:1790779016.379994:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00100000:0.0:1790779016.380002:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642694528:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779016.380030:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642694528:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779016.380036:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00080000:1.0:1790779016.380091:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779016.384061:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642694016 00000100:00100000:2.0:1790779016.384077:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642694016 00000100:00100000:2.0:1790779016.384146:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 309 00000100:00100000:2.0:1790779016.385832:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642694016:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779016.385928:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642694016:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 109us (10073us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779016.385937:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 309 00010000:00010000:2.0:1790779017.131915:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779017.320087:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779017.320115:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663742976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779017.320193:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779017.320266:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663743104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779017.320292:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779017.320331:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663742976 00000100:00100000:0.0:1790779017.320338:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663742976 00000100:00100000:0.0:1790779017.320381:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663743104 00000100:00100000:0.0:1790779017.320385:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663743104 00000100:00100000:0.0:1790779017.320400:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790779017.320407:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663742976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779017.320435:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779017.320477:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663742976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779017.320483:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790779017.320509:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790779017.320514:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663743104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779017.320523:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779017.320550:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663743104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779017.320556:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1790779017.320574:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790779017.320603:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c0e680 x1877767663743104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779017.320621:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663743104:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1790779017.320648:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c0d880 x1877767663742976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779017.320658:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663742976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790779018.153072:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779018.344843:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779018.344866:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663743232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779018.344960:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779018.344981:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779018.344996:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663743360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779018.345034:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779018.345084:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663743232 00000100:00100000:2.0:1790779018.345092:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663743232 00000100:00100000:2.0:1790779018.345155:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663743360 00000100:00100000:2.0:1790779018.345160:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663743360 00000100:00080000:0.0:1790779018.345184:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779018.345186:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790779018.345205:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790779018.345210:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663743232:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779018.345232:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663743360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779018.345254:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1790779018.345255:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779018.345303:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663743360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779018.345310:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663743232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779018.345315:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790779018.345322:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790779018.345342:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663743744:0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.345351:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663743488:0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.345376:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779018.345390:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779018.345410:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663744256:0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.345422:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663744000:0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.345441:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779018.345451:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779018.345463:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663744768:0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.345473:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663744512:0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.345490:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779018.345506:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779018.345513:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790779018.345522:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663743616:0@lo:400:kworker.0 00010000:00080000:2.0:1790779018.345539:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603912300 x1877767663743360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779018.345551:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779018.345564:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663743360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779018.345583:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790779018.345584:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663744128:0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.345592:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663743872:0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.345611:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779018.345628:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663743744 00000100:00100000:2.0:1790779018.345632:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663743744 00000100:00100000:0.0:1790779018.345639:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663744640:0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.345651:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663744000 00000100:00100000:2.0:1790779018.345656:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663744000 00000100:00100000:0.0:1790779018.345679:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779018.345685:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790779018.345693:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663743744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.345711:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663743488 00000100:00100000:0.0:1790779018.345717:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663743488 00000100:00100000:2.0:1790779018.345740:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663743744:12345-0@lo:400:kworker.0 Request processed in 48us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779018.345749:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790779018.345752:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1790779018.345762:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663743488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.345774:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790779018.345783:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663744000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.345800:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663743488:12345-0@lo:400:kworker.0 Request processed in 39us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779018.345807:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1790779018.345824:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663744000:12345-0@lo:400:kworker.0 Request processed in 42us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779018.345832:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790779018.345841:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663744256 00000100:00100000:0.0:1790779018.345846:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663744256 00000100:00100000:2.0:1790779018.345867:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663743744:0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.345877:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663744768 00000100:00100000:0.0:1790779018.345902:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663744768 00000100:00100000:0.0:1790779018.345918:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663743616 00000100:00100000:0.0:1790779018.345921:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663743616 00000100:00100000:0.0:1790779018.345937:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663744128 00000100:00100000:0.0:1790779018.345940:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663744128 00010000:00080000:2.0:1790779018.345945:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a3ce00 x1877767663743232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779018.345952:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663744640 00000100:00100000:0.0:1790779018.345956:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663744640 00000100:00100000:2.0:1790779018.345961:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663743232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779018.345985:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790779018.345993:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663744256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.345998:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779018.346014:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663744384:0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.346042:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663744256:12345-0@lo:400:kworker.0 Request processed in 49us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779018.346047:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779018.346055:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790779018.346070:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663743872 00000100:00100000:0.0:1790779018.346074:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663743872 00000100:00100000:2.0:1790779018.346076:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663743488:0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.346090:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663744000:0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.346094:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790779018.346104:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663744768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.346136:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663744768:12345-0@lo:400:kworker.0 Request processed in 34us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779018.346141:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790779018.346150:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790779018.346154:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663743616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.346166:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790779018.346175:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663744128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.346194:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663743616:12345-0@lo:400:kworker.0 Request processed in 43us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779018.346202:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790779018.346213:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663744128:12345-0@lo:400:kworker.0 Request processed in 39us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779018.346220:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790779018.346228:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663744640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.346256:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663744640:12345-0@lo:400:kworker.0 Request processed in 30us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779018.346427:0:6525:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1790779018.346437:0:6525:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1790779018.346456:0:6524:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1790779018.346798:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790779018.346816:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790779018.346823:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663743872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.347178:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790779018.347202:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663743872:12345-0@lo:400:kworker.0 Request processed in 378us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779018.347210:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790779018.347221:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663744512 00000100:00100000:2.0:1790779018.347227:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663744512 00000100:00100000:2.0:1790779018.347313:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663744384 00000100:00100000:2.0:1790779018.347317:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663744384 00000100:00100000:2.0:1790779018.347334:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790779018.347341:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663744512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.347374:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663744512:12345-0@lo:400:kworker.0 Request processed in 34us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779018.347380:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790779018.347392:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790779018.347398:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663744384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.347424:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663744384:12345-0@lo:400:kworker.0 Request processed in 27us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779018.347430:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1790779018.347467:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779018.347471:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779018.347493:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663743616:0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.347503:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663744128:0@lo:400:kworker.0 00000100:00100000:2.0:1790779018.347512:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663744640:0@lo:400:kworker.0 00010000:00080000:2.0:1790779018.347521:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603833b80 x1877767663744256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779018.347530:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663744256:0@lo:400:kworker.0 00010000:00080000:2.0:1790779018.347539:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603830700 x1877767663744768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779018.347556:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663744768:0@lo:400:kworker.0 00000100:00100000:3.0:1790779018.349550:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663743872:0@lo:400:kworker.0 00010000:00080000:3.0:1790779018.349568:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603833100 x1877767663744384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779018.349577:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663744384:0@lo:400:kworker.0 00010000:00080000:3.0:1790779018.349589:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603832680 x1877767663744512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779018.349597:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663744512:0@lo:400:kworker.0 00000100:00100000:0.0:1790779018.857071:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663744896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779018.857390:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779018.857576:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663744896 00000100:00100000:3.0:1790779018.857586:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663744896 00000100:00100000:3.0:1790779018.857634:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790779018.857642:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663744896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779018.857694:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790779018.857745:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663744896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779018.857752:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790779018.857799:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663744896:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790779019.177741:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790779019.342809:0:13040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1790779020.201139:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779020.915374:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663745024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779020.915454:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779020.915752:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663745024 00000100:00100000:2.0:1790779020.915761:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663745024 00000100:00100000:2.0:1790779020.915843:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790779020.915853:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663745024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779020.915912:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790779020.916080:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663745024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 229us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779020.916088:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790779020.916166:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663745024:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790779021.224580:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779021.489652:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779021.489695:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779021.489732:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779021.489749:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779021.489780:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779021.489806:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642695040 00000100:00100000:1.0:1790779021.489816:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642695040 00000100:00100000:1.0:1790779021.489867:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642695168 00000100:00100000:1.0:1790779021.489870:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642695168 00000100:00100000:1.0:1790779021.489909:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642695296 00000100:00100000:1.0:1790779021.489913:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642695296 00000100:00100000:1.0:1790779021.489926:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642695424 00000100:00100000:1.0:1790779021.489928:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642695424 00000100:00100000:1.0:1790779021.489945:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:1.0:1790779021.489954:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642695040:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779021.490037:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642695040:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 83us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779021.490045:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:1.0:1790779021.490063:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00100000:1.0:1790779021.490069:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642695168:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779021.490109:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642695168:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 40us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779021.490115:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00100000:1.0:1790779021.490129:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 173 00000100:00100000:1.0:1790779021.490136:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642695296:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779021.490161:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642695296:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779021.490167:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 173 00000100:00100000:1.0:1790779021.490177:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 174 00000100:00100000:1.0:1790779021.490184:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642695424:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779021.490207:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642695424:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779021.490213:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 174 00000100:00100000:3.0:1790779021.490422:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642694912 00000100:00100000:3.0:1790779021.490427:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642694912 00000100:00100000:3.0:1790779021.490463:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 311 00000100:00100000:3.0:1790779021.490471:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642694912:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779021.490499:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642694912:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779021.490506:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 311 00000100:00080000:2.0:1790779021.490774:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779021.490780:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1790779021.933087:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b44070bd-520a-4282-a6d8-dd7e751e819e 00000020:00000080:0.0:1790779021.933097:0:8432:0:(genops.c:885:class_export_put()) final put ffff9b76038f5800/b44070bd-520a-4282-a6d8-dd7e751e819e 00000020:00000080:3.0:1790779021.933192:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b76038f5800/b44070bd-520a-4282-a6d8-dd7e751e819e for lustre-OST0000 00000020:00000080:3.0:1790779021.933244:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b76038f2800 for lustre-OST0000 00000001:00100000:1.0:1790779021.933334:0:9517:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b44070bd-520a-4282-a6d8-dd7e751e819e 00000020:00000080:1.0:1790779021.933338:0:9517:0:(genops.c:885:class_export_put()) final put ffff9b76038f6000/b44070bd-520a-4282-a6d8-dd7e751e819e 00000020:00000080:0.0:1790779021.933379:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b76038f6000/b44070bd-520a-4282-a6d8-dd7e751e819e for lustre-OST0001 00000020:00000080:0.0:1790779021.933405:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b76038f6800 for lustre-OST0001 00010000:00010000:3.0:1790779022.250006:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779022.440804:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790779022.440828:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663745152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779022.440918:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779022.441023:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663745152 00000100:00100000:0.0:1790779022.441032:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663745152 00000100:00100000:0.0:1790779022.441084:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790779022.441093:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663745152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779022.441128:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779022.441172:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663745152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779022.441178:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1790779022.441219:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a8700 x1877767663745152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779022.441237:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663745152:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790779022.441357:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779022.441457:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779022.441469:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663745280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779022.441510:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779022.441577:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663745280 00000100:00100000:0.0:1790779022.441582:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663745280 00000100:00100000:0.0:1790779022.441720:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790779022.441727:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663745280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779022.441737:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779022.441773:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663745280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779022.441779:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1790779022.441868:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041a5880 x1877767663745280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779022.441907:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663745280:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790779022.442134:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1790779022.838020:0:13189:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee0150a80 20000000:00000080:2.0:1790779022.838038:0:13189:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b7601e2ac00 uarg=0000000000000000 20000000:01000000:2.0:1790779022.838081:0:13189:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790779022.838088:0:13189:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790779022.838093:0:13189:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790779022.849037:0:13190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1790779022.849187:0:13189:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790779022.854288:0:13189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790779022.854321:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.854343:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936cc12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256bc expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.854365:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936cc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc19 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.854373:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936cc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc27 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.854379:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cc3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc35 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.854387:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7718769e00/0xb1aa4014e936cc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc43 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.854394:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77055cfc00/0xb1aa4014e936cc5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256fb expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.854403:0:13189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.854445:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77055cfc00/0xb1aa4014e936cc5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256fb expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.854462:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b77055cfc00/0xb1aa4014e936cc5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256fb expref: 12 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.854477:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663745408:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779022.854797:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7718769e00/0xb1aa4014e936cc4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936cc43 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.854806:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7718769e00/0xb1aa4014e936cc4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936cc43 expref: 23 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.854824:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663745536:0@lo:104: 00000100:00100000:3.0:1790779022.854864:0:13189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790779022.855186:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cc3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936cc35 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.855195:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cc3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936cc35 expref: 23 pid: 6518 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.855203:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663745664:0@lo:104: 00000100:00100000:3.0:1790779022.855224:0:13189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779022.856816:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663745536 00000100:00100000:1.0:1790779022.856826:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663745536 00000100:00100000:1.0:1790779022.856915:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790779022.856924:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:13189:x1877767663745536:12345-0@lo:104: 00010000:00010000:1.0:1790779022.856939:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779022.857015:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790779022.857020:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:13189:x1877767663745536:12345-0@lo:104: Request processed in 98us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779022.857027:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1790779022.857051:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779022.857057:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779022.857065:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779022.857070:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779022.857094:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779022.857100:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779022.857106:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790779022.857139:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779022.857145:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779022.857179:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779022.857186:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936cc43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc4a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779022.857199:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779022.857201:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779022.857203:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779022.857222:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663745792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779022.857268:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779022.857317:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663745792 00000100:00100000:1.0:1790779022.857321:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663745792 00010000:00010000:1.0:1790779022.857337:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7718769e00/0xb1aa4014e936cc4a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc43 expref: 24 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779022.857359:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790779022.857366:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663745792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779022.857375:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779022.857380:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7718769e00/0xb1aa4014e936cc4a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc43 expref: 24 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779022.857390:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7718769e00/0xb1aa4014e936cc4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936cc43 expref: 24 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779022.857405:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779022.857429:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663745792:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779022.857436:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790779022.857468:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663745792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779022.858450:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936cc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936cc27 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.858465:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936cc2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936cc27 expref: 23 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.858477:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663745920:0@lo:104: 00000100:00100000:3.0:1790779022.858510:0:13189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790779022.858539:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936cc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936cc19 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.858557:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936cc20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936cc19 expref: 23 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.858566:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663746048:0@lo:104: 00000100:00100000:3.0:1790779022.858587:0:13189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779022.858691:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663745664 00000100:00100000:2.0:1790779022.858698:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663745664 00000100:00100000:2.0:1790779022.858727:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663745920 00000100:00100000:2.0:1790779022.858731:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663745920 00000100:00100000:2.0:1790779022.858740:0:6507:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663746048 00000100:00100000:2.0:1790779022.858743:0:6507:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663746048 00000100:00100000:2.0:1790779022.858768:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790779022.858776:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+5:13189:x1877767663745664:12345-0@lo:104: 00010000:00010000:2.0:1790779022.858788:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.858834:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790779022.858839:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+5:13189:x1877767663745664:12345-0@lo:104: Request processed in 64us (3614us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779022.858845:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790779022.858860:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790779022.858866:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:13189:x1877767663745920:12345-0@lo:104: 00010000:00010000:2.0:1790779022.858873:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.858931:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790779022.858935:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+4:13189:x1877767663745920:12345-0@lo:104: Request processed in 71us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779022.858941:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790779022.858952:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790779022.858958:0:6507:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:13189:x1877767663746048:12345-0@lo:104: 00010000:00010000:2.0:1790779022.858964:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.858994:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790779022.858999:0:6507:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3110940-f102-4234-a689-7d64ccf7427e+3:13189:x1877767663746048:12345-0@lo:104: Request processed in 42us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779022.859005:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1790779022.859022:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790779022.859033:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859040:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cf400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779022.859043:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859052:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779022.859059:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779022.859065:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779022.859089:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859097:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779022.859112:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859119:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77055cf400/0xb1aa4014e936cc35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859130:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779022.859133:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859139:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769600 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779022.859142:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859158:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779022.859164:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779022.859170:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779022.859181:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859187:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779022.859200:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859206:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718769600/0xb1aa4014e936cc27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859214:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779022.859217:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859222:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce600 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779022.859224:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859230:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779022.859236:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779022.859246:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779022.859273:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859279:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779022.859285:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859291:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77055ce600/0xb1aa4014e936cc19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc20 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859303:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779022.859305:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779022.859306:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779022.859317:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663746304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779022.859343:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779022.859364:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779022.859369:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663746432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779022.859387:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779022.859412:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663746304 00000100:00100000:2.0:1790779022.859417:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663746304 00010000:00010000:2.0:1790779022.859432:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936cc2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc27 expref: 24 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779022.859452:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663746432 00000100:00100000:2.0:1790779022.859455:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663746432 00010000:00010000:2.0:1790779022.859465:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936cc20 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc19 expref: 25 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779022.859496:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790779022.859502:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+25:3649:x1877767663746304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779022.859512:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779022.859517:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936cc2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc27 expref: 25 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859526:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936cc2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936cc27 expref: 25 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859539:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779022.859567:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+25:3649:x1877767663746304:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779022.859573:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790779022.859584:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790779022.859590:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663746432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779022.859786:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936cc12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256bc expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.859809:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936cc12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256bc expref: 12 pid: 6515 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.859819:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663746560:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779022.859901:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779022.859908:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936cc20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc19 expref: 24 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859916:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936cc20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936cc19 expref: 24 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.859926:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779022.859951:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663746432:12345-0@lo:103:ldlm_bl.0 Request processed in 362us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779022.859958:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790779022.859994:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663746432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779022.860013:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663746304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790779022.860243:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779022.860265:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663746176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779022.860303:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790779022.860352:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779022.860421:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663746176 00000100:00100000:2.0:1790779022.860426:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663746176 00010000:00010000:2.0:1790779022.860444:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cc3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc35 expref: 24 pid: 6518 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779022.860475:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790779022.860483:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663746176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779022.860492:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779022.860496:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cc3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc35 expref: 24 pid: 6518 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.860504:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cc3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936cc35 expref: 24 pid: 6518 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.860514:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779022.860553:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663746176:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779022.860559:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790779022.860720:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663746176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790779022.860828:0:13189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603808000 going to sleep for 11 seconds 00010000:00010000:3.0:1790779022.860847:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769e00/0xb1aa4014e936cc4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936cc43 expref: 23 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.860858:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663745536:0@lo:104: 00010000:00010000:3.0:1790779022.860867:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cea00/0xb1aa4014e936cc3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936cc35 expref: 22 pid: 6518 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.860875:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663745664:0@lo:104: 00010000:00010000:3.0:1790779022.860907:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936cc2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936cc27 expref: 21 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.860916:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663745920:0@lo:104: 00010000:00010000:3.0:1790779022.860924:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6a00/0xb1aa4014e936cc20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936cc19 expref: 20 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.860932:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663746048:0@lo:104: 00000100:00100000:1.0:1790779022.861988:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779022.862026:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642695552 00000100:00100000:1.0:1790779022.862032:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642695552 00010000:00010000:1.0:1790779022.862063:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77055cfc00/0xb1aa4014e936cc5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256fb expref: 13 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779022.862091:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:1.0:1790779022.862099:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642695552:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779022.862110:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779022.862114:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77055cfc00/0xb1aa4014e936cc5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256fb expref: 13 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779022.862125:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77055cfc00/0xb1aa4014e936cc5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256fb expref: 13 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779022.862139:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779022.862181:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642695552:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779022.862187:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00010000:00010000:0.0:1790779022.862961:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cfc00/0xb1aa4014e936cc5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256fb expref: 12 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779022.862974:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663745408:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779022.866462:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779022.866550:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1877767663746560:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779022.866590:0:13189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.866715:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642695680 00000100:00100000:3.0:1790779022.866723:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642695680 00010000:00010000:3.0:1790779022.866759:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936cc12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256bc expref: 12 pid: 6515 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779022.866799:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:3.0:1790779022.866821:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:2401:x1877767642695680:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779022.866836:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779022.866842:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936cc12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256bc expref: 12 pid: 6515 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.866854:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936cc12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256bc expref: 12 pid: 6515 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.866871:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936cc12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256bc expref: 12 pid: 6515 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.866910:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.866919:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.866935:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.866942:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.866948:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.866955:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.866960:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e6200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779022.866964:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.866979:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.866995:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779022.867004:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779022.867059:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:2401:x1877767642695680:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 239us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779022.867068:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00010000:00010000:2.0:1790779022.867198:0:13189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.867206:0:13189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779022.867212:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936cc82 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.272135:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779023.464520:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779023.464556:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663746688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779023.464647:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779023.464876:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663746688 00000100:00100000:3.0:1790779023.464905:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663746688 00000100:00100000:3.0:1790779023.464959:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790779023.464969:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663746688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790779023.464998:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779023.465060:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663746688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.465068:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1790779023.465115:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a3d180 x1877767663746688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779023.465133:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663746688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779023.465499:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663746816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779023.465534:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790779023.466407:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779023.466459:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663746944:0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.466497:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.466532:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663747456:0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.466567:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.466708:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663747968:0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.466737:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.466757:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790779023.466763:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663747072:0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.466787:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.466804:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663747584:0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.466843:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.466955:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663748096:0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.466986:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.467017:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663747328:0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.467038:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.467176:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663747840:0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.467205:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.467223:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790779023.467228:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663747200:0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.467249:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.467263:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663747712:0@lo:400:kworker.0 00000100:00100000:1.0:1790779023.467385:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663746816 00000100:00100000:1.0:1790779023.467393:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663746816 00000100:00100000:1.0:1790779023.467448:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790779023.467456:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663746816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790779023.467476:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779023.467534:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663747456 00000100:00100000:3.0:1790779023.467547:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663747456 00000100:00100000:3.0:1790779023.467569:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663747200 00000100:00100000:3.0:1790779023.467571:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663747200 00000100:00100000:3.0:1790779023.467584:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790779023.467599:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663747456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779023.467689:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663746944 00000100:00100000:2.0:1790779023.467693:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663746944 00000100:00100000:2.0:1790779023.467722:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1790779023.467729:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:3649:x1877767663746944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779023.468586:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663746816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1128us (3048us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779023.468595:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790779023.468637:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663747072 00000100:00100000:1.0:1790779023.468653:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663747072 00000100:00100000:1.0:1790779023.468685:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663747584 00000100:00100000:1.0:1790779023.468688:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663747584 00000100:00100000:1.0:1790779023.468703:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663748096 00000100:00100000:1.0:1790779023.468705:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663748096 00000100:00100000:1.0:1790779023.468715:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663747328 00000100:00100000:1.0:1790779023.468717:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663747328 00000100:00100000:1.0:1790779023.468728:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790779023.468733:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663747072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779023.468772:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663747072:12345-0@lo:400:kworker.0 Request processed in 39us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779023.468778:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790779023.468789:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790779023.468794:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663747584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779023.468906:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663747584:12345-0@lo:400:kworker.0 Request processed in 110us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779023.468917:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790779023.468919:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663747456:12345-0@lo:400:kworker.0 Request processed in 1323us (2346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.468930:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790779023.468935:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790779023.468943:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663748096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779023.468952:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790779023.468962:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663747200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779023.468980:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663748096:12345-0@lo:400:kworker.0 Request processed in 37us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779023.468987:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790779023.469002:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663747200:12345-0@lo:400:kworker.0 Request processed in 42us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779023.469004:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790779023.469015:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790779023.469018:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663747328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779023.469052:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663747328:12345-0@lo:400:kworker.0 Request processed in 40us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779023.469058:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1790779023.469086:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790779023.469090:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779023.469121:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663747072:0@lo:400:kworker.0 00000100:00100000:1.0:1790779023.469131:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663747584:0@lo:400:kworker.0 00000100:00100000:1.0:1790779023.469140:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663748096:0@lo:400:kworker.0 00000100:00100000:1.0:1790779023.469148:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663747456:0@lo:400:kworker.0 00000100:00100000:3.0:1790779023.469240:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663747968 00000100:00100000:3.0:1790779023.469245:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663747968 00000100:00100000:3.0:1790779023.469285:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663747840 00000100:00100000:3.0:1790779023.469292:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663747840 00000100:00100000:3.0:1790779023.469313:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790779023.469320:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663747968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779023.469362:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663747968:12345-0@lo:400:kworker.0 Request processed in 44us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.469368:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790779023.469379:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790779023.469385:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663747840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779023.469414:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663747840:12345-0@lo:400:kworker.0 Request processed in 29us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.469421:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790779023.470391:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.470427:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663748224:0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.470455:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.470484:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663747328:0@lo:400:kworker.0 00010000:00080000:0.0:1790779023.470497:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b76a680 x1877767663747840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779023.470507:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663747840:0@lo:400:kworker.0 00010000:00080000:0.0:1790779023.470519:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7a9f80 x1877767663746816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779023.470534:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663746816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779023.470806:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663747200:0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.470829:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663747712 00000100:00100000:0.0:1790779023.470833:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663747712 00000100:00100000:0.0:1790779023.470907:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663748224 00000100:00100000:0.0:1790779023.470922:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663748224 00000100:00100000:0.0:1790779023.470950:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790779023.470958:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663747712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.471005:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663747712:12345-0@lo:400:kworker.0 Request processed in 48us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.471011:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790779023.471024:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790779023.471030:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663748224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779023.471067:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663748224:12345-0@lo:400:kworker.0 Request processed in 37us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.471073:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00010000:00080000:0.0:1790779023.471100:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a3e300 x1877767663747712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779023.471121:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663747712:0@lo:400:kworker.0 00010000:00080000:0.0:1790779023.471133:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d1f80 x1877767663748224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779023.471151:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663748224:0@lo:400:kworker.0 00000100:00080000:3.0:1790779023.471561:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779023.471739:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+20:3649:x1877767663746944:12345-0@lo:400:kworker.0 Request processed in 4008us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779023.471748:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1790779023.471927:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663746944:0@lo:400:kworker.0 00010000:00080000:1.0:1790779023.471942:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d0000 x1877767663747968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779023.471950:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663747968:0@lo:400:kworker.0 10000000:01000000:0.0:1790779023.977947:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790779023.977954:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b760310d000 from 7 10000000:01000000:0.0:1790779023.977960:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790779023.978004:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.978016:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.978027:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779023.978059:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663748352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.978130:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.978179:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.978215:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663748352 00000100:00100000:0.0:1790779023.978221:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663748352 00000100:00100000:0.0:1790779023.978271:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1790779023.978280:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663748352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779023.978292:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779023.978304:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cc90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cc89 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.978325:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cc90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cc89 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.978334:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cc90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc89 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.978343:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769000, rc 0) 00000100:00100000:0.0:1790779023.978382:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663748352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.978390:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1790779023.978436:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663748352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779023.978452:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.978461:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779023.978529:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663748480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.978569:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.978584:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.978597:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663748480 00000100:00100000:0.0:1790779023.978600:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663748480 00000100:00100000:0.0:1790779023.978632:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1790779023.978638:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663748480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.978751:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663748480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.978757:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1790779023.978788:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663748480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.978820:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663748608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.978853:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.978864:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.978873:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663748608 00000100:00100000:0.0:1790779023.978876:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663748608 00000100:00100000:0.0:1790779023.978909:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1790779023.978914:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663748608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.978975:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663748608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.978981:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1790779023.979022:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663748608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779023.982947:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663748736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779023.983015:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779023.983073:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663748736 00000100:00100000:3.0:1790779023.983092:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663748736 00000100:00100000:3.0:1790779023.983134:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790779023.983143:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663748736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779023.983176:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790779023.983220:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663748736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.983228:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790779023.983272:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663748736:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1790779023.985449:0:13212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790779023.986189:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790779023.986214:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779023.986225:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.986238:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779023.986248:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790779023.986251:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b77344a6000 from 7 10000000:01000000:1.0:1790779023.986254:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779023.986290:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.986299:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.986322:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779023.986347:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663748864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779023.986406:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.986449:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.990860:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663748864 00000100:00100000:0.0:1790779023.990899:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663748864 00000100:00100000:0.0:1790779023.990960:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1790779023.990971:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663748864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779023.990989:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779023.991006:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cc9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cc97 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.991032:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cc9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cc97 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.991043:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cc9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc97 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.991051:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769200, rc 0) 00000100:00100000:0.0:1790779023.991124:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663748864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (4717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.991131:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1790779023.991232:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663748864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779023.991252:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.991261:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779023.991335:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663748992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779023.991368:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.991408:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.991455:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663748992 00000100:00100000:0.0:1790779023.991460:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663748992 00000100:00100000:0.0:1790779023.991494:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1790779023.991501:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7703020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663748992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.991645:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7703020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663748992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.991653:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1790779023.991685:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663748992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.991715:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.991764:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.991781:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.991793:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663749120 00000100:00100000:0.0:1790779023.991797:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663749120 00000100:00100000:0.0:1790779023.991821:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1790779023.991828:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663749120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.991931:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663749120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.991939:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1790779023.991982:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790779023.992643:0:13214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790779023.992695:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790779023.992713:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779023.992721:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.992731:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779023.992741:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790779023.992743:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7712708000 from 7 10000000:01000000:0.0:1790779023.992746:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790779023.992766:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.992774:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.992783:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779023.992805:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.992839:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.992858:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.992873:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663749248 00000100:00100000:0.0:1790779023.992896:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663749248 00000100:00100000:0.0:1790779023.992921:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1790779023.992928:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663749248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779023.992936:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779023.992944:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ccac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936cca5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.992961:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ccac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936cca5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.992970:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ccac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cca5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.992977:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769a00, rc 0) 00000100:00100000:0.0:1790779023.993005:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663749248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.993012:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1790779023.993044:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779023.993057:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.993065:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779023.993108:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.993131:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.993143:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa5840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.993152:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663749376 00000100:00100000:0.0:1790779023.993155:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663749376 00000100:00100000:0.0:1790779023.993173:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1790779023.993178:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663749376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.993248:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663749376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.993255:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1790779023.993281:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.993316:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.993349:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.993362:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa5840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.993373:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663749504 00000100:00100000:0.0:1790779023.993377:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663749504 00000100:00100000:0.0:1790779023.993398:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1790779023.993404:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663749504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779023.993464:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663749504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.993471:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1790779023.993505:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790779023.994260:0:13215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790779023.994311:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790779023.994325:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779023.994333:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.994343:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779023.994351:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790779023.994354:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b77208a9000 from 7 10000000:01000000:0.0:1790779023.994356:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790779023.994374:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.994382:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.994390:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779023.999985:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779024.000063:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779024.000104:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779024.001643:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663749632 00000100:00100000:1.0:1790779024.001654:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663749632 00000100:00100000:1.0:1790779024.001713:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1790779024.001724:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663749632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779024.001743:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779024.001764:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ccba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ccb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779024.001793:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ccba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ccb3 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779024.001819:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ccba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ccb3 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779024.001828:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cf000, rc 0) 00000100:00100000:1.0:1790779024.001911:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663749632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779024.001917:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1790779024.002827:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779024.002848:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779024.002858:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779024.002964:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779024.003005:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779024.003041:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779024.003109:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663749760 00000100:00100000:1.0:1790779024.003115:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663749760 00000100:00100000:1.0:1790779024.003154:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1790779024.003162:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663749760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779024.003287:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663749760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779024.003295:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1790779024.003690:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708946300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779024.003726:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779024.003768:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779024.003794:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603808600 going to sleep for 11 seconds 00000100:00100000:1.0:1790779024.003843:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663749888 00000100:00100000:1.0:1790779024.003847:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663749888 00000100:00100000:1.0:1790779024.003877:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1790779024.003903:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663749888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779024.003982:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663749888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779024.003989:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1790779024.004750:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663749888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790779024.006164:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790779024.006714:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790779024.006738:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779024.006748:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779024.006761:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779024.296194:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779024.563411:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779024.563675:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642695808 00000100:00100000:3.0:1790779024.563687:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642695808 00000100:00100000:3.0:1790779024.563746:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 325 00000100:00100000:3.0:1790779024.563755:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:6170:x1877767642695808:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779024.563783:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779024.563801:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ccc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b42572c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779024.563827:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ccc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42572c expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779024.563839:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ccc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42572c expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779024.563859:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6c00, rc 0) 00000100:00100000:3.0:1790779024.563987:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642695808:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 232us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779024.563993:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 325 00000100:00100000:0.0:1790779024.573137:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779024.573234:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642695936 00000100:00100000:1.0:1790779024.573245:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642695936 00000100:00100000:1.0:1790779024.573305:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 326 00000100:00100000:1.0:1790779024.573314:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642695936:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779024.573449:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642695936:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 135us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779024.573457:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 326 00000100:00100000:0.0:1790779024.578407:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779024.579723:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642696064 00000100:00100000:1.0:1790779024.579735:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642696064 00000100:00100000:1.0:1790779024.579794:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 327 00000100:00100000:1.0:1790779024.579803:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642696064:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779024.579952:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642696064:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 149us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779024.579960:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 327 00000100:00100000:0.0:1790779024.592476:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779024.592942:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642696192 00000100:00100000:3.0:1790779024.592953:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642696192 00000100:00100000:3.0:1790779024.593005:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 328 00000100:00100000:3.0:1790779024.593013:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642696192:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779024.593029:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779024.593045:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e7e00/0xb1aa4014e936ccc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425733 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779024.593071:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e7e00/0xb1aa4014e936ccc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425733 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779024.593082:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e7e00/0xb1aa4014e936ccc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425733 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779024.593091:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e7e00, rc 0) 00000100:00100000:3.0:1790779024.593144:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:6170:x1877767642696192:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 131us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779024.593151:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 328 00000100:00100000:3.0:1790779024.602853:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779024.606555:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642696320 00000100:00100000:0.0:1790779024.606570:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642696320 00000100:00100000:0.0:1790779024.606750:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 329 00000100:00100000:0.0:1790779024.606761:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:6170:x1877767642696320:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779024.606914:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:6170:x1877767642696320:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 155us (4068us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779024.606922:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 329 00000100:00100000:0.0:1790779024.614103:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779024.615904:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642696448 00000100:00100000:2.0:1790779024.615917:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642696448 00000100:00100000:2.0:1790779024.616026:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 330 00000100:00100000:2.0:1790779024.616036:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:6170:x1877767642696448:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790779024.616167:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:6170:x1877767642696448:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 133us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779024.616175:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 330 00010000:00010000:0.0:1790779025.321019:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779026.029747:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663750016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779026.029820:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779026.029872:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663750016 00000100:00100000:3.0:1790779026.029902:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663750016 00000100:00100000:3.0:1790779026.029950:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790779026.029966:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663750016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790779026.030003:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790779026.033761:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663750016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3785us (3929us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779026.033874:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790779026.036155:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663750016:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790779026.345038:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779026.622555:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779026.625854:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779026.625905:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779026.625934:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779026.625971:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779026.625996:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642696704 00000100:00100000:2.0:1790779026.626011:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642696704 00000100:00100000:2.0:1790779026.626064:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642696960 00000100:00100000:2.0:1790779026.626069:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642696960 00000100:00100000:2.0:1790779026.626084:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642696832 00000100:00100000:2.0:1790779026.626086:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642696832 00000100:00100000:2.0:1790779026.626097:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642697088 00000100:00100000:2.0:1790779026.626099:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642697088 00000100:00100000:2.0:1790779026.626116:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:2.0:1790779026.626124:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642696704:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779026.626214:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642696704:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 90us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779026.626221:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:2.0:1790779026.626238:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:2.0:1790779026.626245:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642696960:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779026.626271:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642696960:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779026.626277:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:2.0:1790779026.626288:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:2.0:1790779026.626294:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642696832:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779026.626318:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642696832:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779026.626324:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:2.0:1790779026.626336:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:2.0:1790779026.626341:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642697088:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779026.626365:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642697088:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 24us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779026.626381:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00080000:3.0:1790779026.626456:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779026.626461:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779026.628075:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642696576 00000100:00100000:0.0:1790779026.628088:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642696576 00000100:00100000:0.0:1790779026.628137:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 331 00000100:00100000:0.0:1790779026.628153:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2398:x1877767642696576:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779026.628212:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2398:x1877767642696576:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 61us (5667us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779026.628220:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 331 00000001:02000400:3.0:1790779026.917725:0:13388:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790779027.368573:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779027.560375:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779027.560779:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779027.567866:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663750144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779027.567963:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779027.568039:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663750144 00000100:00100000:0.0:1790779027.568049:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663750144 00000100:00100000:0.0:1790779027.568112:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790779027.568122:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663750144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779027.568153:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779027.568202:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663750144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779027.568209:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1790779027.568299:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7708944380 x1877767663750144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779027.568316:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663750144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779027.568333:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663750272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779027.568368:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779027.568555:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663750272 00000100:00100000:1.0:1790779027.568560:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663750272 00000100:00100000:1.0:1790779027.568611:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790779027.568617:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663750272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790779027.568627:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779027.568666:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663750272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779027.568672:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1790779027.568871:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7708945c00 x1877767663750272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779027.568907:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663750272:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790779027.569066:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790779028.392021:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779028.584070:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663750400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779028.584133:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779028.584286:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663750400 00000100:00100000:0.0:1790779028.584294:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663750400 00000100:00100000:0.0:1790779028.584354:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790779028.584364:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663750400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779028.584391:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779028.584437:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663750400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779028.584444:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1790779028.585806:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790779028.586056:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7708947100 x1877767663750400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779028.586081:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663750400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779028.586622:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663750656:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.586676:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779028.586704:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663751168:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.586726:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779028.586751:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663751680:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.586771:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779028.586790:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790779028.586795:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663750528:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.586818:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779028.586836:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663751040:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.586858:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779028.586874:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663751552:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.586927:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779028.586979:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663750656 00000100:00100000:2.0:1790779028.586985:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663750656 00000100:00100000:2.0:1790779028.587021:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663751168 00000100:00100000:2.0:1790779028.587025:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663751168 00000100:00100000:2.0:1790779028.587048:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663751680 00000100:00100000:2.0:1790779028.587051:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663751680 00000100:00100000:2.0:1790779028.587067:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790779028.587075:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663750656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779028.587107:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790779028.587116:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663751168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.587121:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663750656:12345-0@lo:400:kworker.0 Request processed in 47us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779028.587128:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790779028.587142:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790779028.587146:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663751168:12345-0@lo:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779028.587147:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663751680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779028.587152:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790779028.587170:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663750912:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.587171:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663751680:12345-0@lo:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779028.587177:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790779028.587192:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779028.587199:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663750528 00000100:00100000:2.0:1790779028.587202:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663750528 00000100:00100000:1.0:1790779028.587207:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663751424:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.587223:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1790779028.587229:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663750528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779028.587286:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663751552 00000100:00100000:3.0:1790779028.587290:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663751552 00000100:00100000:3.0:1790779028.587317:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790779028.587324:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663751552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779028.594641:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663750912 00000100:00100000:0.0:1790779028.594657:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663750912 00000100:00100000:2.0:1790779028.594804:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663750528:12345-0@lo:400:kworker.0 Request processed in 7570us (7979us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779028.594816:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1790779028.594848:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663751040 00000100:00100000:2.0:1790779028.594853:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663751040 00000100:00100000:2.0:1790779028.594900:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790779028.594908:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663751040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779028.595042:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790779028.595050:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663750912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779028.595093:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663750912:12345-0@lo:400:kworker.0 Request processed in 44us (7900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779028.595114:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790779028.595297:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663751040:12345-0@lo:400:kworker.0 Request processed in 389us (8437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779028.595310:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1790779028.595328:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779028.595363:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663750528:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.595376:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663751040:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.595388:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663750656:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.595398:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663751168:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.595408:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663751680:0@lo:400:kworker.0 00000100:00100000:2.0:1790779028.595432:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779028.595444:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663752064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779028.595477:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779028.596066:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663752064 00000100:00100000:0.0:1790779028.596072:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663752064 00000100:00100000:0.0:1790779028.596113:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790779028.596121:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663752064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779028.596138:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779028.596180:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663752064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779028.596187:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1790779028.596202:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790779028.596225:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7708944700 x1877767663752064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779028.596242:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663752064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779028.598054:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663750784:0@lo:400:kworker.0 00000100:00100000:3.0:1790779028.598111:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779028.598142:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663751296:0@lo:400:kworker.0 00000100:00100000:3.0:1790779028.598166:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779028.598186:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663751808:0@lo:400:kworker.0 00000100:00100000:3.0:1790779028.598207:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779028.598245:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663750784 00000100:00100000:3.0:1790779028.598251:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663750784 00000100:00100000:3.0:1790779028.598286:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790779028.598295:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663750784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779028.598346:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663750784:12345-0@lo:400:kworker.0 Request processed in 51us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779028.598353:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790779028.598388:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663751296 00000100:00100000:3.0:1790779028.598392:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663751296 00000100:00100000:3.0:1790779028.598420:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663751808 00000100:00100000:3.0:1790779028.598423:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663751808 00000100:00100000:3.0:1790779028.598444:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1790779028.598449:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663751296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779028.598482:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663751296:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779028.598487:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1790779028.598499:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1790779028.598505:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663751808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779028.598532:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663751808:12345-0@lo:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779028.598537:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1790779028.598558:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790779028.598593:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663750784:0@lo:400:kworker.0 00010000:00080000:3.0:1790779028.598608:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603912300 x1877767663751296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779028.598618:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663751296:0@lo:400:kworker.0 00010000:00080000:3.0:1790779028.598626:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603022d80 x1877767663751808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779028.598633:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663751808:0@lo:400:kworker.0 00000100:00100000:3.0:1790779028.598680:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663751552:12345-0@lo:400:kworker.0 Request processed in 11356us (11753us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779028.598688:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1790779028.598726:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603022300 x1877767663751552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779028.598735:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663751552:0@lo:400:kworker.0 00000100:00100000:3.0:1790779028.602192:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779028.602280:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663751936:0@lo:400:kworker.0 00000100:00100000:3.0:1790779028.602326:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779028.602613:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663751424 00000100:00100000:1.0:1790779028.602621:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663751424 00000100:00100000:1.0:1790779028.602678:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663751936 00000100:00100000:1.0:1790779028.602681:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663751936 00000100:00100000:3.0:1790779028.602861:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790779028.602872:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663751424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779028.602929:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790779028.603044:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663751936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779028.603116:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663751936:12345-0@lo:400:kworker.0 Request processed in 178us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779028.603120:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663751424:12345-0@lo:400:kworker.0 Request processed in 249us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779028.603128:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790779028.603134:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1790779028.603178:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603023b80 x1877767663751936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779028.603193:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663751936:0@lo:400:kworker.0 00000100:00100000:3.0:1790779028.603224:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663750912:0@lo:400:kworker.0 00010000:00080000:3.0:1790779028.603236:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603023800 x1877767663751424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779028.603244:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663751424:0@lo:400:kworker.0 00000100:00100000:3.0:1790779029.107108:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663752192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779029.107178:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779029.108795:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663752192 00000100:00100000:2.0:1790779029.108807:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663752192 00000100:00100000:2.0:1790779029.108876:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790779029.108905:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663752192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790779029.108943:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790779029.119912:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663752192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10977us (12702us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779029.119927:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790779029.129143:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663752192:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790779029.416241:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779030.440594:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779031.145521:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663752320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779031.145599:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779031.145647:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663752320 00000100:00100000:0.0:1790779031.145656:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663752320 00000100:00100000:0.0:1790779031.145705:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790779031.145714:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663752320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779031.145747:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790779031.145804:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663752320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779031.145819:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790779031.145988:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663752320:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790779031.464044:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779031.731450:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779031.731657:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642697344 00000100:00100000:3.0:1790779031.731668:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642697344 00000100:00100000:3.0:1790779031.731739:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:3.0:1790779031.731749:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642697344:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779031.731831:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642697344:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 84us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779031.731839:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00080000:0.0:1790779031.732766:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779031.736127:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779031.736171:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779031.736206:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779031.736246:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779031.736258:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642697600 00000100:00100000:2.0:1790779031.736269:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642697600 00000100:00100000:2.0:1790779031.736335:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642697728 00000100:00100000:2.0:1790779031.736339:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642697728 00000100:00100000:2.0:1790779031.736359:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642697472 00000100:00100000:2.0:1790779031.736376:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642697472 00000100:00080000:1.0:1790779031.736380:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790779031.736392:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779031.736405:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:2.0:1790779031.736417:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642697600:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779031.736429:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:1.0:1790779031.736442:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642697728:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779031.736495:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642697600:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779031.736503:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:2.0:1790779031.736528:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 194 00000100:00100000:2.0:1790779031.736535:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642697472:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779031.736573:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642697216 00000100:00100000:1.0:1790779031.736578:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642697728:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 137us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779031.736585:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642697472:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 45us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779031.736590:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642697216 00000100:00100000:1.0:1790779031.736597:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:3.0:1790779031.736673:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 333 00000100:00100000:3.0:1790779031.736687:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642697216:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779031.736757:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642697216:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 73us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779031.736765:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 333 00000100:00100000:2.0:1790779031.737977:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 194 00010000:00010000:2.0:1790779032.489717:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779032.680865:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779032.680949:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663752448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779032.681083:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779032.681254:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663752448 00000100:00100000:0.0:1790779032.681266:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663752448 00000100:00100000:0.0:1790779032.681349:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790779032.681361:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663752448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779032.681404:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779032.681466:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663752448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779032.681473:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1790779032.682148:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790779032.682206:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7708947800 x1877767663752448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779032.682232:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663752448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779032.682446:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663752576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779032.682506:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779032.682686:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663752576 00000100:00100000:1.0:1790779032.682692:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663752576 00000100:00100000:1.0:1790779032.682759:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790779032.682769:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663752576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790779032.682791:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779032.682836:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663752576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779032.682843:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1790779032.683125:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7708946680 x1877767663752576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779032.683141:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663752576:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790779032.683268:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1790779032.757768:0:13536:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:37:10 (1790779030) === 00000100:00100000:1.0:1790779033.073478:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779033.073570:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779033.075005:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642697984 00000100:00100000:3.0:1790779033.075025:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642697984 00000100:00100000:3.0:1790779033.075123:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:3.0:1790779033.075137:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:10486:x1877767642697984:12345-192.168.203.3@tcp:700:mkdir.0 00000100:00100000:3.0:1790779033.075252:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:10486:x1877767642697984:12345-192.168.203.3@tcp:700:mkdir.0 Request processed in 118us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779033.075261:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00080000:0.0:1790779033.075331:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779033.075971:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642697856 00000100:00100000:2.0:1790779033.075979:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642697856 00000100:00100000:2.0:1790779033.076030:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1790779033.076039:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642697856:12345-192.168.203.3@tcp:41:mkdir.0 00000004:00000024:2.0:1790779033.076074:0:6523:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790779033.076161:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642697856:12345-192.168.203.3@tcp:41:mkdir.0 Request processed in 122us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.076168:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:1.0:1790779033.081104:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779033.081195:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642698240 00000100:00100000:0.0:1790779033.081207:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642698240 00000100:00100000:3.0:1790779033.084791:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:3.0:1790779033.084844:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+6:10486:x1877767642698240:12345-192.168.203.3@tcp:36:mkdir.0 00010000:00010000:3.0:1790779033.084953:0:13003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779033.087003:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936cb71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256a7 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.087031:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603614800) 00010000:00010000:3.0:1790779033.087076:0:13003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779033.091027:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cccf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.091063:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cccf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.091101:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cccf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.093745:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.093768:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.093781:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095699:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095718:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095728:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779033.095744:0:13003:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bcc7bc95 reply state 0000000063fe7af7 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095755:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095763:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:2.0:1790779033.095766:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779033.095771:0:13003:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790779033.095777:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790779033.095793:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cccf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095799:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cccf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095807:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cccf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095813:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779033.095816:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cccf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095823:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cccf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095832:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a96800) 00010000:00010000:2.0:1790779033.095835:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779033.095839:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cccf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095844:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cccf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779033.095862:0:13003:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bcc7bc95 reply state 0000000063fe7af7 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.095869:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.096512:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b7712a96b00) 00010000:00010000:2.0:1790779033.096515:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779033.096526:0:13003:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790779033.096635:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+7:10486:x1877767642698240:12345-192.168.203.3@tcp:36:mkdir.0 Request processed in 11800us (15541us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790779033.096644:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:0.0:1790779033.107086:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779033.107193:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642698368 00000100:00100000:2.0:1790779033.107203:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642698368 00000100:00100000:2.0:1790779033.107265:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1790779033.107275:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:10487:x1877767642698368:12345-192.168.203.3@tcp:101:chmod.0 00010000:00010000:2.0:1790779033.107297:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779033.107319:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cce4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42573a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.107387:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cceb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.107401:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.107411:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779033.107449:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790779033.107454:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779033.107491:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.107516:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cce4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42573a expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.107535:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cceb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42573a expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.107575:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a96800) 00010000:00010000:2.0:1790779033.107579:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779033.107582:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2400, rc 0) 00000100:00100000:2.0:1790779033.107647:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+8:10487:x1877767642698368:12345-192.168.203.3@tcp:101:chmod.0 Request processed in 373us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.107653:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1790779033.116826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779033.116976:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642698624 00000100:00100000:3.0:1790779033.116989:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642698624 00000100:00100000:3.0:1790779033.117065:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1790779033.117077:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:10487:x1877767642698624:12345-192.168.203.3@tcp:36:chmod.0 00010000:00010000:3.0:1790779033.117157:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779033.117193:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cceb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42573a expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.117218:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a96800) 00010000:00010000:3.0:1790779033.117230:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779033.117334:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.117351:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.117363:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779033.119169:0:6525:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002f379cc2 reply state 0000000087670ca0 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.119202:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.119213:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7720809200) 00010000:00010000:2.0:1790779033.119216:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790779033.119220:0:6525:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790779033.119232:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790779033.119488:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+9:10487:x1877767642698624:12345-192.168.203.3@tcp:36:chmod.0 Request processed in 2408us (2672us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790779033.119499:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:0.0:1790779033.161326:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779033.168493:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642698752 00000100:00100000:2.0:1790779033.168517:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642698752 00000100:00100000:2.0:1790779033.168780:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:2.0:1790779033.168792:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+9:10488:x1877767642698752:12345-192.168.203.3@tcp:101:chown.0 00010000:00010000:2.0:1790779033.168826:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779033.168852:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936ccf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425741 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.168990:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936cd00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.169007:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936cd00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.169021:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936cd00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779033.169077:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790779033.169082:0:13003:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779033.169132:0:13003:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936cd00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.169164:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936ccf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425741 expref: 11 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.169187:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936cd00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425741 expref: 10 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.169197:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7720809200) 00010000:00010000:2.0:1790779033.169200:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779033.169204:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2c00, rc 0) 00000100:00100000:2.0:1790779033.169301:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+10:10488:x1877767642698752:12345-192.168.203.3@tcp:101:chown.0 Request processed in 511us (7991us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.169309:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:0.0:1790779033.176836:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779033.177367:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642698880 00000100:00100000:1.0:1790779033.177380:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642698880 00000100:00100000:1.0:1790779033.177496:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1790779033.177509:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+10:10488:x1877767642698880:12345-192.168.203.3@tcp:101:chown.0 00010000:00010000:1.0:1790779033.177538:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779033.177578:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cd07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425748 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.177668:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cd0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.177687:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cd0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.177702:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cd0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.177716:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.177724:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.177730:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178073:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cd1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178454:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cd1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178465:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cd1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779033.178526:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790779033.178531:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779033.178569:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cd1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178583:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cd0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178591:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cd0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178599:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cd0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178606:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779033.178611:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cd0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178619:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cd0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178633:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7720809200) 00010000:00010000:1.0:1790779033.178637:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779033.178642:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cd0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178661:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cd0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178677:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178683:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178689:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178694:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779033.178697:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178704:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178713:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b7712a96b00) 00010000:00010000:1.0:1790779033.178716:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779033.178719:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.178724:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.179240:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cd07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425748 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.179260:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cd1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425748 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.179278:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:1.0:1790779033.179281:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790779033.179284:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cf400, rc 0) 00000100:00100000:1.0:1790779033.179379:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+11:10488:x1877767642698880:12345-192.168.203.3@tcp:101:chown.0 Request processed in 1873us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779033.179388:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1790779033.184248:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779033.184534:0:6534:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642699008 00000100:00100000:0.0:1790779033.184558:0:6534:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642699008 00000100:00100000:0.0:1790779033.184638:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:0.0:1790779033.184660:0:6534:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e5203316-d1cf-49fe-9b64-c701aab9b690+11:10488:x1877767642699008:12345-192.168.203.3@tcp:900:chown.0 00000100:00100000:0.0:1790779033.184780:0:6534:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e5203316-d1cf-49fe-9b64-c701aab9b690+11:10488:x1877767642699008:12345-192.168.203.3@tcp:900:chown.0 Request processed in 132us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779033.184788:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:0.0:1790779033.189013:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779033.189114:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642699264 00000100:00100000:2.0:1790779033.189127:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642699264 00000100:00100000:2.0:1790779033.189214:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:2.0:1790779033.189225:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+11:10488:x1877767642699264:12345-192.168.203.3@tcp:36:chown.0 00010000:00010000:2.0:1790779033.189299:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779033.189335:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cd1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425748 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.189357:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:2.0:1790779033.189362:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779033.189403:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.189420:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.189432:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790779033.204446:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1790779033.204616:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204660:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204670:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204687:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779033.204693:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204703:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204725:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779033.204729:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779033.204736:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204743:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936ccd6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204773:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204780:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204786:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204792:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779033.204801:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204808:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204817:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:3.0:1790779033.204820:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779033.204824:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204830:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936ccdd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204845:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204852:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204858:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204863:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e6200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779033.204866:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204872:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204953:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7720809200) 00010000:00010000:3.0:1790779033.204957:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790779033.204969:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.204976:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936ccf2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779033.205099:0:6525:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b4325ac5 reply state 000000002fc46799 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.205116:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.205124:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:2.0:1790779033.205127:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790779033.205130:0:6525:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790779033.205156:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1790779033.205276:0:6525:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1790779033.205301:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:10488:x1877767642699264:12345-192.168.203.3@tcp:36:chown.0 Request processed in 16073us (16296us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790779033.205312:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00010000:00010000:3.0:1790779033.206627:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.206644:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.206652:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.206659:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779033.206664:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.206744:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.206764:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:3.0:1790779033.206767:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790779033.206771:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.206778:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cd23 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779033.227291:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779033.227564:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642699392 00000100:00100000:3.0:1790779033.227579:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642699392 00000100:00100000:1.0:1790779033.227928:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:1.0:1790779033.227942:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:10489:x1877767642699392:12345-192.168.203.3@tcp:101:touch.500 00010000:00010000:1.0:1790779033.227976:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779033.228003:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42574f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790779033.241042:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 12970us 00010000:00010000:0.0:1790779033.252534:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cd31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.252573:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cd31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.252589:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cd31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.252611:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.252619:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.252626:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253021:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936cd3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253033:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936cd3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253042:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936cd3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779033.253083:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790779033.253087:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779033.253135:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936cd3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253215:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cd31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253232:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cd31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253240:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cd31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253247:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779033.253252:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cd31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253262:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cd31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253276:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7720809200) 00010000:00010000:0.0:1790779033.253280:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779033.253285:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cd31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253291:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cd31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253304:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253311:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253317:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253322:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779033.253332:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253339:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253348:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b7603616700) 00010000:00010000:0.0:1790779033.253350:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779033.253353:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253359:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253408:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce000/0xb1aa4014e936cd2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42574f expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253427:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936cd3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42574f expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.253435:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7603616900) 00010000:00010000:0.0:1790779033.253437:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790779033.253440:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769600, rc 0) 00000100:00100000:0.0:1790779033.253647:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:10489:x1877767642699392:12345-192.168.203.3@tcp:101:touch.500 Request processed in 25705us (26369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779033.253658:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:1.0:1790779033.257862:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779033.258003:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642699648 00000100:00100000:2.0:1790779033.258018:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642699648 00000100:00100000:2.0:1790779033.258098:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:2.0:1790779033.258110:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:10489:x1877767642699648:12345-192.168.203.3@tcp:101:touch.500 00010000:00010000:2.0:1790779033.258139:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779033.258165:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd46 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425756 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.258299:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cd4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.258317:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cd4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.258329:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cd4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.263706:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.263729:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.263741:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790779033.264186:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1790779033.264379:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cd5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.264391:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cd5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.264424:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cd5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.271196:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cd4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.271215:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cd4d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.271224:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cd4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.271230:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779033.271235:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cd4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.271243:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cd4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.271260:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7603616900) 00010000:00010000:2.0:1790779033.271263:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779033.271268:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cd4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.271275:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cd4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779033.271295:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000bd0bec8 reply state 000000009a24e980 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.271309:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.271365:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff9b7712a96f00) 00010000:00010000:2.0:1790779033.271369:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779033.271372:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790779033.271453:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425756 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.271470:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cd5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425756 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.271478:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b7712a96100) 00010000:00010000:2.0:1790779033.271480:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779033.271483:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3400, rc 0) 00000100:00100000:2.0:1790779033.271568:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+10:10489:x1877767642699648:12345-192.168.203.3@tcp:101:touch.500 Request processed in 13458us (13718us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790779033.271577:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:1.0:1790779033.278428:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779033.278567:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642699904 00000100:00100000:2.0:1790779033.278577:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642699904 00000100:00100000:2.0:1790779033.278634:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:2.0:1790779033.278643:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+10:10489:x1877767642699904:12345-192.168.203.3@tcp:36:touch.500 00010000:00010000:2.0:1790779033.278701:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779033.278731:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cd5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425756 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.278751:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b7712a96100) 00010000:00010000:2.0:1790779033.278761:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779033.278808:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.278835:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.278845:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779033.278987:0:6525:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008341cd42 reply state 0000000054572963 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.278999:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.279005:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b7712a96300) 00010000:00010000:2.0:1790779033.279008:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779033.279010:0:6525:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790779033.279100:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+11:10489:x1877767642699904:12345-192.168.203.3@tcp:36:touch.500 Request processed in 457us (692us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790779033.279108:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0:1790779033.285487:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779033.285621:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642700032 00000100:00100000:0.0:1790779033.285649:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642700032 00000100:00100000:0.0:1790779033.285740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:0.0:1790779033.285754:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+11:10489:x1877767642700032:12345-192.168.203.3@tcp:101:touch.500 00010000:00010000:0.0:1790779033.285809:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779033.285837:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42575d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.285956:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42575d expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.285974:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42575d expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779033.285997:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b7712a96300) 00010000:00010000:0.0:1790779033.286000:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790779033.286005:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768600, rc 0) 00000100:00100000:0.0:1790779033.286067:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+12:10489:x1877767642700032:12345-192.168.203.3@tcp:101:touch.500 Request processed in 317us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779033.286074:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:1.0:1790779033.291279:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779033.291411:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642700160 00000100:00100000:3.0:1790779033.291442:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642700160 00000100:00100000:3.0:1790779033.291510:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1790779033.291520:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1877767642700160:12345-192.168.203.3@tcp:8:touch.500 00010000:00080000:3.0:1790779033.291586:0:8440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:3.0:1790779033.291626:0:8440:0:(genops.c:1384:class_connect()) connect: client e5203316-d1cf-49fe-9b64-c701aab9b690, cookie 0xb1aa4014e936cd77 00002000:00100000:3.0:1790779033.291643:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e5203316-d1cf-49fe-9b64-c701aab9b690/ffff9b773f4f8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790779033.291658:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790779033.291765:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790779033.291805:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9b773f4f9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779033.291941:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2397:x1877767642700160:12345-192.168.203.3@tcp:8:touch.500 Request processed in 421us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779033.291950:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1790779033.304823:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779033.304986:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642700288 00000100:00100000:0.0:1790779033.304999:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642700288 00000100:00100000:0.0:1790779033.305091:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:0.0:1790779033.305104:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:0:x1877767642700288:12345-192.168.203.3@tcp:2:touch.500 00000100:00080000:1.0:1790779033.305373:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1790779033.307539:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1790779033.307568:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000100:00100000:2.0:1790779033.319349:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:0:x1877767642700288:12345-192.168.203.3@tcp:2:touch.500 Request processed in 14233us (14525us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790779033.319367:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:0.0:1790779033.325422:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779033.326231:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642700544 00000100:00100000:1.0:1790779033.326246:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642700544 00000100:00100000:1.0:1790779033.326328:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:1.0:1790779033.326341:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+12:10489:x1877767642700544:12345-192.168.203.3@tcp:35:touch.500 00000100:00100000:1.0:1790779033.326807:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+13:10489:x1877767642700544:12345-192.168.203.3@tcp:35:touch.500 Request processed in 466us (1397us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790779033.326816:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:1.0:1790779033.342679:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779033.342937:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642700672 00000100:00100000:3.0:1790779033.342952:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642700672 00000100:00100000:3.0:1790779033.343031:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:3.0:1790779033.343043:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+13:10490:x1877767642700672:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:3.0:1790779033.343077:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779033.343103:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936cd7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425764 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.343193:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936cd85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.343212:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936cd85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.343226:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936cd85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779033.343757:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790779033.343762:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779033.343815:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936cd85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.343853:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6200/0xb1aa4014e936cd7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425764 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.343876:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936cd85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425764 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779033.343953:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7603616900) 00010000:00010000:3.0:1790779033.343957:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779033.343962:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6a00, rc 0) 00000100:00100000:3.0:1790779033.344169:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+14:10490:x1877767642700672:12345-192.168.203.3@tcp:101:rm.0 Request processed in 1126us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779033.344178:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:0.0:1790779033.363958:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779033.364143:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642700928 00000100:00100000:2.0:1790779033.364155:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642700928 00000100:00100000:2.0:1790779033.364234:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:2.0:1790779033.364245:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+14:10490:x1877767642700928:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:2.0:1790779033.364274:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779033.364302:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cd8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42576b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779033.364470:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790779033.364617:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cd8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42576b expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.364633:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7720809200) 00010000:00010000:2.0:1790779033.364637:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779033.364643:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cd8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42576b expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.364661:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3400, rc 0) 00000100:00100000:2.0:1790779033.364734:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+15:10490:x1877767642700928:12345-192.168.203.3@tcp:101:rm.0 Request processed in 490us (790us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1790779033.364742:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:0.0:1790779033.378174:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779033.378304:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642701056 00000100:00100000:2.0:1790779033.378317:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642701056 00000100:00100000:2.0:1790779033.378389:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:2.0:1790779033.378402:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+15:10490:x1877767642701056:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:2.0:1790779033.382518:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+15:10490:x1877767642701056:12345-192.168.203.3@tcp:37:rm.0 Request processed in 4101us (4341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.382535:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1790779033.386539:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779033.386690:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642701312 00000100:00100000:1.0:1790779033.386704:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642701312 00000100:00100000:1.0:1790779033.386778:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:1.0:1790779033.386791:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718267c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+15:10490:x1877767642701312:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:1.0:1790779033.387276:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718267c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+16:10490:x1877767642701312:12345-192.168.203.3@tcp:35:rm.0 Request processed in 486us (757us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790779033.387285:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1790779033.392825:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779033.392994:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642701568 00000100:00100000:2.0:1790779033.393007:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642701568 00000100:00100000:2.0:1790779033.393082:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:2.0:1790779033.393093:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+16:10490:x1877767642701568:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:2.0:1790779033.393125:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779033.393169:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cd9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425772 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.393320:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cda1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.393339:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cda1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.393354:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cda1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779033.393367:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790779033.393563:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cd9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425772 expref: 19 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.393586:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cda1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425772 expref: 18 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.393595:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7603616900) 00010000:00010000:2.0:1790779033.393598:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790779033.393602:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3800, rc 0) 00000100:00100000:2.0:1790779033.393685:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+18:10490:x1877767642701568:12345-192.168.203.3@tcp:101:rm.0 Request processed in 592us (874us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790779033.393693:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:3.0:1790779033.398542:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779033.398718:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642701696 00000100:00100000:1.0:1790779033.398732:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642701696 00000100:00100000:1.0:1790779033.398807:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:1.0:1790779033.398818:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+18:10490:x1877767642701696:12345-192.168.203.3@tcp:41:rm.0 00000004:00000024:1.0:1790779033.398923:0:10428:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1790779033.399006:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+18:10490:x1877767642701696:12345-192.168.203.3@tcp:41:rm.0 Request processed in 189us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779033.399015:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:0.0:1790779033.403079:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779033.403440:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642701824 00000100:00100000:1.0:1790779033.403453:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642701824 00000100:00100000:1.0:1790779033.403704:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:1.0:1790779033.403718:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+18:10490:x1877767642701824:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:1.0:1790779033.403747:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779033.403774:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cdaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425779 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.403936:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cdb6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.403954:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cdb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.403967:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cdb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.403980:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cdbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.403988:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cdbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.403995:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cdbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404118:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cdc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404128:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404134:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779033.404179:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790779033.404184:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779033.404207:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404232:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404242:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cdb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404249:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cdb6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404256:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cdb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404263:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779033.404268:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cdb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404277:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cdb6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404291:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7603616900) 00010000:00010000:1.0:1790779033.404295:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779033.404302:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cdb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404308:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cdb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404324:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cdbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404330:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cdbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404341:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cdbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404348:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cf400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779033.404351:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cdbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404357:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cdbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404366:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff9b7712a96f00) 00010000:00010000:1.0:1790779033.404368:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779033.404372:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cdbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404378:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cdbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404410:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce200/0xb1aa4014e936cdaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425779 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404424:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425779 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.404432:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b7712a96300) 00010000:00010000:1.0:1790779033.404434:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779033.404437:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055ce600, rc 0) 00000100:00100000:1.0:1790779033.404543:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+19:10490:x1877767642701824:12345-192.168.203.3@tcp:101:rm.0 Request processed in 828us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779033.404570:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:0.0:1790779033.408063:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779033.409087:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642702080 00000100:00100000:2.0:1790779033.409104:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642702080 00000100:00100000:2.0:1790779033.409178:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:2.0:1790779033.409190:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+19:10490:x1877767642702080:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:2.0:1790779033.409343:0:13003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790779033.409718:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cdc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425779 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.409751:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768600/0xb1aa4014e936cd70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42575d expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.409763:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b7712a96300) 00010000:00010000:2.0:1790779033.409775:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936cd85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425764 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.409787:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7603616900) 00010000:00010000:2.0:1790779033.409791:0:13003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779033.409820:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cdcb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.409836:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cdcb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.409849:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cdcb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.409863:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.409871:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.409903:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410026:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936cdd9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410035:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936cdd9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410043:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936cdd9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779033.410740:0:13003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1790779033.410756:0:13003:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351417875380ns, next at 352417871523ns, rc = 0 00010000:00010000:2.0:1790779033.410823:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936cde0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410837:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936cde0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410846:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936cde0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410855:0:13003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936cde0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410862:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936cde0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410869:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936cde0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410923:0:13003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779033.410950:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936cdd9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410968:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936cdd9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410975:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936cdd9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410981:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779033.410987:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936cdd9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.410995:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936cdd9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.411006:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b7712a96300) 00010000:00010000:2.0:1790779033.411009:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790779033.411014:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936cdd9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.411019:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936cdd9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.411040:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cdcb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.411046:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cdcb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.411052:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cdcb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.411057:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779033.411066:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cdcb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.411073:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cdcb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.411082:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7603616900) 00010000:00010000:2.0:1790779033.411085:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779033.411088:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cdcb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.411094:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936cdcb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779033.411106:0:13003:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ece533a3 reply state 00000000957d16ed transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.411119:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.411126:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff9b7712a96f00) 00010000:00010000:2.0:1790779033.411129:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779033.411132:0:13003:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790779033.411340:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779033.411348:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936cde0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.411355:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779033.411358:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936cde0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.411365:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936cde0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.411375:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b7712a96300) 00010000:00010000:1.0:1790779033.411377:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790779033.411380:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936cde0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.411386:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936cde0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779033.411397:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779033.411399:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779033.411401:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779033.411510:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+18:10490:x1877767642702080:12345-192.168.203.3@tcp:36:rm.0 Request processed in 2319us (3457us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790779033.411597:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:1.0:1790779033.415430:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779033.415650:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642702336 00000100:00100000:0.0:1790779033.415663:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642702336 00000100:00100000:0.0:1790779033.415770:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1790779033.415783:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+18:10490:x1877767642702336:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:0.0:1790779033.416118:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+19:10490:x1877767642702336:12345-192.168.203.3@tcp:35:rm.0 Request processed in 337us (702us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790779033.416128:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:1.0:1790779033.419300:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779033.419396:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642702592 00000100:00100000:2.0:1790779033.419408:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642702592 00000100:00100000:2.0:1790779033.419487:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:2.0:1790779033.419499:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+19:10490:x1877767642702592:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:2.0:1790779033.419736:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790779033.419790:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936cda1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425772 expref: 19 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.419816:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936cd3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42574f expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.419828:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7603616900) 00010000:00010000:2.0:1790779033.419848:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936cd00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425741 expref: 17 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.419857:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7720809200) 00010000:00010000:2.0:1790779033.419864:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779033.419921:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cde7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.419938:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cde7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.419949:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cde7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.419963:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.419970:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.419977:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420085:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cdf5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420100:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cdf5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420108:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cdf5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779033.420399:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790779033.420418:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cdf5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420427:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cdf5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420435:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cdf5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420441:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ae00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779033.420446:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cdf5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420455:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cdf5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420477:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b7712a96100) 00010000:00010000:2.0:1790779033.420480:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790779033.420484:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cdf5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420491:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cdf5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420514:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cde7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420794:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cde7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420801:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cde7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420807:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779033.420811:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cde7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420818:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cde7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420827:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a96900) 00010000:00010000:2.0:1790779033.420830:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779033.420833:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cde7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420839:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936cde7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779033.420854:0:6525:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004dd29e70 reply state 000000005a29f5a4 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420866:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779033.420873:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b7712a96000) 00010000:00010000:2.0:1790779033.420876:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779033.420951:0:6525:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790779033.421086:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+18:10490:x1877767642702592:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1586us (1797us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790779033.421102:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00010000:00010000:0.0:1790779033.512184:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779033.704955:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779033.704986:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663752704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790779033.705076:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779033.705168:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663752704 00000100:00100000:1.0:1790779033.705178:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663752704 00000100:00100000:1.0:1790779033.705253:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790779033.705265:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663752704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790779033.705302:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779033.705349:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663752704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779033.705357:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1790779033.705384:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790779033.705415:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b772fe25180 x1877767663752704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779033.705435:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663752704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779033.705979:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663752832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779033.706022:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779033.706389:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663752960:0@lo:400:kworker.0 00000100:00100000:3.0:1790779033.706428:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779033.706453:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663753472:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.706561:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663752960 00000100:00100000:2.0:1790779033.706567:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663752960 00000100:00100000:2.0:1790779033.706610:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1790779033.706620:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663752960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.706662:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663752960:12345-0@lo:400:kworker.0 Request processed in 43us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.706669:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1790779033.706728:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663753344:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.706755:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779033.706783:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663753856:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.706809:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779033.706840:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663753088:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.706864:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779033.706907:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663753600:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.706927:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779033.706945:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663754112:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.706964:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779033.706980:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790779033.706985:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663753216:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.707010:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779033.707030:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663753728:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.707077:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779033.707096:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663754240:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.707118:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779033.707140:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663753344 00000100:00100000:2.0:1790779033.707144:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663753344 00000100:00100000:2.0:1790779033.707167:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663753088 00000100:00100000:2.0:1790779033.707169:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663753088 00000100:00100000:2.0:1790779033.707182:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663753600 00000100:00100000:2.0:1790779033.707185:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663753600 00000100:00100000:2.0:1790779033.707206:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663754112 00000100:00100000:2.0:1790779033.707209:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663754112 00000100:00100000:2.0:1790779033.707221:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663753728 00000100:00100000:2.0:1790779033.707225:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663753728 00000100:00100000:2.0:1790779033.707239:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663754240 00000100:00100000:2.0:1790779033.707241:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663754240 00000100:00100000:2.0:1790779033.707258:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790779033.707264:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663753344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.707305:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663753344:12345-0@lo:400:kworker.0 Request processed in 41us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.707312:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790779033.707327:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1790779033.707334:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663753088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.707366:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663753088:12345-0@lo:400:kworker.0 Request processed in 33us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.707372:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1790779033.707384:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790779033.707390:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663753600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.707418:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663753600:12345-0@lo:400:kworker.0 Request processed in 29us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.707431:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790779033.707443:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790779033.707448:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663754112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779033.708330:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779033.708363:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663753984:0@lo:400:kworker.0 00000100:00100000:3.0:1790779033.708395:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779033.708437:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663752960:0@lo:400:kworker.0 00000100:00100000:3.0:1790779033.708569:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1790779033.708582:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663753728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779033.708627:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663753728:12345-0@lo:400:kworker.0 Request processed in 48us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779033.708634:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1790779033.708653:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1790779033.708661:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663754240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779033.711480:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663752832 00000100:00100000:0.0:1790779033.711502:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663752832 00000100:00100000:0.0:1790779033.711598:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790779033.711610:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663752832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779033.711644:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779033.711756:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663753856 00000100:00100000:1.0:1790779033.711762:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663753856 00000100:00100000:1.0:1790779033.711815:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663753984 00000100:00100000:1.0:1790779033.711819:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663753984 00000100:00100000:1.0:1790779033.711842:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790779033.711850:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663753856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.713996:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663754112:12345-0@lo:400:kworker.0 Request processed in 6533us (7016us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.714013:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790779033.714076:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663753216 00000100:00100000:2.0:1790779033.714085:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663753216 00000100:00100000:2.0:1790779033.714122:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663753472 00000100:00100000:2.0:1790779033.714125:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663753472 00000100:00100000:2.0:1790779033.714138:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790779033.714146:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663753216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.714207:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663753216:12345-0@lo:400:kworker.0 Request processed in 62us (7197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.714213:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790779033.714223:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790779033.714228:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663753472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.714278:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663753472:12345-0@lo:400:kworker.0 Request processed in 49us (5952us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.714284:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790779033.714453:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663753344:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.714494:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790779033.714504:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663753984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.714540:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663753984:12345-0@lo:400:kworker.0 Request processed in 39us (6145us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779033.714577:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790779033.714612:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663753216:0@lo:400:kworker.0 00010000:00080000:2.0:1790779033.714629:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603b6ca80 x1877767663753728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779033.714641:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663753728:0@lo:400:kworker.0 00010000:00080000:2.0:1790779033.714654:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603b6c000 x1877767663754240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779033.714662:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663754240:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.714675:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663753088:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.715413:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663753600:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.715437:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663754112:0@lo:400:kworker.0 00000100:00100000:2.0:1790779033.715516:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663753472:0@lo:400:kworker.0 00010000:00080000:2.0:1790779033.715531:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603b6d500 x1877767663753984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779033.715541:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663753984:0@lo:400:kworker.0 00000100:00080000:2.0:1790779033.715606:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790779033.715614:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779033.715618:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779033.717199:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663752832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5580us (11164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779033.717216:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1790779033.722955:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7708947800 x1877767663752832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779033.722988:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663752832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779033.723914:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663753856:12345-0@lo:400:kworker.0 Request processed in 12056us (17094us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779033.723929:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1790779033.724145:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603b6ea00 x1877767663753856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779033.724160:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663753856:0@lo:400:kworker.0 00000100:00100000:3.0:1790779033.728953:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663754240:12345-0@lo:400:kworker.0 Request processed in 20206us (21746us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779033.728974:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1790779034.217850:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779034.217904:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663754368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779034.218002:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779034.218143:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663754368 00000100:00100000:0.0:1790779034.218154:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663754368 00000100:00100000:0.0:1790779034.218218:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790779034.218229:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663754368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779034.218273:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790779034.218338:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663754368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779034.218346:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790779034.218401:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663754368:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790779034.542696:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779035.562995:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779036.265060:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779036.265084:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663754496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779036.265151:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779036.273571:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663754496 00000100:00100000:3.0:1790779036.273587:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663754496 00000100:00100000:3.0:1790779036.273638:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790779036.273648:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663754496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790779036.273685:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790779036.273776:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663754496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (8624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779036.273783:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790779036.273844:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663754496:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790779036.591309:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779036.852480:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779036.852540:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779036.852573:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779036.852625:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779036.852646:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779036.852686:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779036.852771:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642702848 00000100:00100000:2.0:1790779036.852781:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642702848 00000100:00100000:2.0:1790779036.852843:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642702976 00000100:00100000:2.0:1790779036.852847:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642702976 00000100:00100000:2.0:1790779036.852859:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642703232 00000100:00100000:2.0:1790779036.852862:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642703232 00000100:00100000:2.0:1790779036.852874:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642703360 00000100:00100000:2.0:1790779036.852876:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642703360 00000100:00100000:2.0:1790779036.852952:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00100000:2.0:1790779036.852962:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+18:2398:x1877767642702848:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779036.853033:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+18:2398:x1877767642702848:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 73us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779036.853042:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00100000:2.0:1790779036.853059:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:2.0:1790779036.853065:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642702976:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779036.853091:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642702976:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779036.853097:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:2.0:1790779036.853110:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:2.0:1790779036.853125:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642703232:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779036.853153:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642703232:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779036.853159:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:2.0:1790779036.853171:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 204 00000100:00100000:2.0:1790779036.853177:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642703360:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779036.853200:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642703360:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779036.853205:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 204 00000100:00100000:2.0:1790779036.853228:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642703104 00000100:00100000:2.0:1790779036.853231:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642703104 00000100:00100000:2.0:1790779036.853259:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:2.0:1790779036.853265:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642703104:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779036.853292:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642703104:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779036.853298:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:3.0:1790779036.853513:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642702720 00000100:00100000:3.0:1790779036.853518:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642702720 00000100:00100000:3.0:1790779036.853570:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 335 00000100:00100000:3.0:1790779036.853577:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642702720:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779036.853603:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642702720:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779036.853618:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 335 00000100:00080000:1.0:1790779036.853909:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790779036.853916:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790779036.853918:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790779037.610380:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790779037.801833:0:8853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355808950634ns, next at 356808948109ns, rc = 0 00000100:00100000:3.0:1790779037.801856:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663754624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779037.802003:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779037.802870:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663754752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779037.802941:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779037.803061:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663754624 00000100:00100000:3.0:1790779037.803069:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663754624 00000100:00100000:3.0:1790779037.803120:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663754752 00000100:00100000:3.0:1790779037.803124:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663754752 00000100:00100000:3.0:1790779037.803142:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790779037.803152:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663754624:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779037.803167:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00002000:00000024:3.0:1790779037.803180:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779037.803181:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663754752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790779037.803197:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779037.803234:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663754624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779037.803241:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790779037.803247:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663754752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779037.803255:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1790779037.803321:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790779037.803353:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7708947100 x1877767663754752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779037.803370:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663754752:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1790779037.803414:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603745180 x1877767663754624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779037.803426:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663754624:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1790779038.581749:0:13685:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1790779038.632261:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779038.825674:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663754880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779038.825745:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779038.825805:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663755392:0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.825830:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779038.825852:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663755904:0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.825875:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779038.825915:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663756416:0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.825936:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779038.825960:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1790779038.825966:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663755008:0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.825992:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779038.826015:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663755520:0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826053:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779038.826072:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663756032:0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826090:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779038.826104:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663756544:0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826123:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779038.826150:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663755392 00000100:00100000:3.0:1790779038.826158:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663755392 00000100:00100000:3.0:1790779038.826200:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1790779038.826209:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663755392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826261:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663755392:12345-0@lo:400:kworker.0 Request processed in 54us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779038.826269:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1790779038.826290:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663755904 00000100:00100000:3.0:1790779038.826293:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663755904 00000100:00100000:3.0:1790779038.826308:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663756416 00000100:00100000:3.0:1790779038.826310:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663756416 00000100:00100000:3.0:1790779038.826333:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663756032 00000100:00100000:3.0:1790779038.826336:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663756032 00000100:00100000:3.0:1790779038.826345:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663756544 00000100:00100000:3.0:1790779038.826347:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663756544 00000100:00100000:3.0:1790779038.826362:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790779038.826369:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663755904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826398:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663755904:12345-0@lo:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779038.826404:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790779038.826415:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790779038.826420:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663756416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826455:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663756416:12345-0@lo:400:kworker.0 Request processed in 35us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779038.826461:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790779038.826471:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790779038.826476:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663756032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826498:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663756032:12345-0@lo:400:kworker.0 Request processed in 22us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779038.826503:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790779038.826527:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790779038.826533:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663756544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826556:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663756544:12345-0@lo:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779038.826561:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790779038.826579:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663755008 00000100:00100000:3.0:1790779038.826582:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663755008 00000100:00100000:3.0:1790779038.826605:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1790779038.826610:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663755008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826637:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663755008:12345-0@lo:400:kworker.0 Request processed in 27us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779038.826643:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1790779038.826668:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663755520 00000100:00100000:3.0:1790779038.826672:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663755520 00000100:00100000:3.0:1790779038.826694:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790779038.826700:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663755520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826732:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663755520:12345-0@lo:400:kworker.0 Request processed in 32us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779038.826747:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1790779038.826774:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779038.826806:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663755008:0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826819:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663755520:0@lo:400:kworker.0 00010000:00080000:3.0:1790779038.826831:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4c5880 x1877767663756032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779038.826840:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663756032:0@lo:400:kworker.0 00010000:00080000:3.0:1790779038.826851:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4c4700 x1877767663756544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779038.826860:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663756544:0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.826869:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663755392:0@lo:400:kworker.0 00010000:00080000:3.0:1790779038.826898:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4c7100 x1877767663755904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779038.826906:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663755904:0@lo:400:kworker.0 00010000:00080000:3.0:1790779038.826918:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4c4380 x1877767663756416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779038.826925:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663756416:0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.827448:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663755136:0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.827489:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779038.827527:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663755648:0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.827551:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779038.827566:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663756160:0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.827598:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779038.827617:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7708947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663756672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779038.827640:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779038.827660:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790779038.827668:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663755264:0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.827690:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779038.827705:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663755776:0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.827726:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779038.827741:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663756288:0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.827770:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779038.827802:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663755136 00000100:00100000:0.0:1790779038.827807:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663755136 00000100:00100000:0.0:1790779038.827834:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663755648 00000100:00100000:0.0:1790779038.827837:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663755648 00000100:00100000:0.0:1790779038.827855:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663756160 00000100:00100000:0.0:1790779038.827857:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663756160 00000100:00100000:0.0:1790779038.827868:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663755776 00000100:00100000:0.0:1790779038.827871:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663755776 00000100:00100000:0.0:1790779038.827917:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663756288 00000100:00100000:0.0:1790779038.827920:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663756288 00000100:00100000:0.0:1790779038.827937:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1790779038.827944:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663755136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.827986:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663755136:12345-0@lo:400:kworker.0 Request processed in 42us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779038.827993:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1790779038.828008:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1790779038.828014:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663755648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.828041:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663755648:12345-0@lo:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779038.828046:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1790779038.828057:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790779038.828064:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663756160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.828089:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663756160:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779038.828094:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790779038.828105:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1790779038.828111:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663755776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.828149:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663755776:12345-0@lo:400:kworker.0 Request processed in 38us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779038.828156:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1790779038.828168:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1790779038.828174:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663756288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.828200:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663756288:12345-0@lo:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779038.828205:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1790779038.828224:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663754880 00000100:00100000:0.0:1790779038.828228:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663754880 00000100:00100000:0.0:1790779038.828246:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663756672 00000100:00100000:0.0:1790779038.828249:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663756672 00000100:00100000:0.0:1790779038.828260:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790779038.828267:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663754880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779038.828288:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779038.828321:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663754880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779038.828327:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790779038.828339:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790779038.828345:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663756672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779038.828355:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779038.828377:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663756672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779038.828383:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1790779038.828423:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4c6300 x1877767663755776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779038.828449:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663755776:0@lo:400:kworker.0 00010000:00080000:0.0:1790779038.828463:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4c4a80 x1877767663756288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779038.828472:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663756288:0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.828482:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663755136:0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.828490:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663755648:0@lo:400:kworker.0 00000100:00100000:0.0:1790779038.828499:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663756160:0@lo:400:kworker.0 00010000:00080000:0.0:1790779038.828520:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7708947100 x1877767663756672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779038.828535:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7708947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663756672:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1790779038.828834:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779038.828838:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779038.828849:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663755264 00000100:00100000:3.0:1790779038.828853:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663755264 00000100:00100000:3.0:1790779038.828912:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790779038.828919:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663755264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779038.828981:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663755264:12345-0@lo:400:kworker.0 Request processed in 61us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779038.828988:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:3.0:1790779038.829037:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b772ff32680 x1877767663754880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779038.829049:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663754880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779038.829126:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663755264:0@lo:400:kworker.0 00000004:00080000:0.0:1790779038.844457:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1790779038.844526:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1790779038.844535:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1790779038.844823:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.844837:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.844845:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.844851:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779038.844856:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.844864:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.844915:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff9b7712a96f00) 00010000:00010000:3.0:1790779038.844919:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779038.844925:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.844932:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936cd54 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.844971:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.844978:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.844984:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.844990:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779038.844993:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.844999:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845008:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b7712a96300) 00010000:00010000:3.0:1790779038.845011:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779038.845014:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845020:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936cd69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845039:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845046:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845051:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845063:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779038.845066:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845072:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845080:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff9b7712a96f00) 00010000:00010000:3.0:1790779038.845083:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779038.845085:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845091:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936cdd2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845106:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845112:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845119:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845123:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779038.845126:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845131:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845151:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b7712a96000) 00010000:00010000:3.0:1790779038.845153:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779038.845157:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.845162:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cdee lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779038.845352:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663756800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790779038.845423:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779038.845981:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663756800 00000100:00100000:3.0:1790779038.845989:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663756800 00000100:00100000:3.0:1790779038.846030:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790779038.846039:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663756800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790779038.846067:0:8855:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1790779038.846100:0:8855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6abd1e98, atime: 0x6abd1e98, ctime: 0x6abd1e98, blocks: 0x0 00010000:00010000:3.0:1790779038.846108:0:8855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d400971d/0xb1aa4014e936cdfc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.846123:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1790779038.846127:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779038.846135:0:8855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d400971d/0xb1aa4014e936cdfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.846151:0:8855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d400971d/0xb1aa4014e936cdfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.846161:0:8855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d400971d/0xb1aa4014e936cdfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.846182:0:8855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d400971d/0xb1aa4014e936cdfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779038.846205:0:8855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790779038.846383:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1877767663756800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 346us (960us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790779038.846391:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1790779038.846435:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b772ff32d80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1790779038.846441:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663756800:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1790779038.846654:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779038.846662:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d400971d/0xb1aa4014e936cdfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779038.846670:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e7200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779038.846675:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d400971d/0xb1aa4014e936cdfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779038.846684:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d400971d/0xb1aa4014e936cdfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779038.846702:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d400971d/0xb1aa4014e936cdfc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779038.846710:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d400971d/0xb1aa4014e936cdfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779038.846729:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779038.846731:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779038.846732:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779039.339859:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790779039.339896:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76035c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663756928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779039.339961:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779039.340448:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663756928 00000100:00100000:3.0:1790779039.340457:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663756928 00000100:00100000:3.0:1790779039.340497:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790779039.340518:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663756928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779039.340552:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790779039.340616:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663756928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779039.340623:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790779039.341006:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76035c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663756928:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790779039.661709:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790779039.675029:0:13733:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc915b0ac0 20000000:00000080:2.0:1790779039.675047:0:13733:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b7603b00800 uarg=0000000000000000 20000000:01000000:2.0:1790779039.675169:0:13733:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1790779039.675176:0:13733:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1790779039.675181:0:13733:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1790779039.676301:0:13734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1790779039.676440:0:13733:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1790779039.689236:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1790779039.689274:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1790779039.689290:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1790779039.689308:0:13733:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790779039.689342:0:13733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.689361:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cc90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc89 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.689370:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cc9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cc97 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.689377:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ccac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936cca5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.689384:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ccba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ccb3 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.689394:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ccc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42572c expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.689401:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b77089e7e00/0xb1aa4014e936ccc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425733 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.689423:0:13733:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.689461:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e7e00/0xb1aa4014e936ccc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425733 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.689603:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b77089e7e00/0xb1aa4014e936ccc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425733 expref: 12 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779039.689619:0:13733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757056:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779039.689850:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ccc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42572c expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.689858:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ccc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42572c expref: 12 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779039.689867:0:13733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757184:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779039.690097:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ccba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936ccb3 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.690107:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ccba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936ccb3 expref: 23 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779039.690117:0:13733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757312:0@lo:104: 00000100:00100000:2.0:1790779039.690157:0:13733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790779039.690186:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ccac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936cca5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.690203:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ccac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936cca5 expref: 23 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779039.690212:0:13733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757440:0@lo:104: 00010000:00010000:2.0:1790779039.690237:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cc9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936cc97 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.690244:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cc9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936cc97 expref: 23 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779039.690251:0:13733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757568:0@lo:104: 00010000:00010000:2.0:1790779039.690270:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cc90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936cc89 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.690277:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cc90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936cc89 expref: 23 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779039.690284:0:13733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757696:0@lo:104: 00000100:00100000:2.0:1790779039.690300:0:13733:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603808540 going to sleep for 11 seconds 00000100:00100000:1.0:1790779039.691621:0:6506:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790779039.691654:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779039.691685:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779039.691695:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779039.691704:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663757312 00000100:00100000:1.0:1790779039.691711:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663757312 00000100:00100000:1.0:1790779039.691748:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663757440 00000100:00100000:1.0:1790779039.691750:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663757440 00000100:00100000:1.0:1790779039.691760:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663757568 00000100:00100000:1.0:1790779039.691762:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663757568 00000100:00100000:1.0:1790779039.691769:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663757696 00000100:00100000:1.0:1790779039.691771:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663757696 00000100:00100000:1.0:1790779039.691782:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790779039.691789:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603976c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+6:13733:x1877767663757312:12345-0@lo:104: 00010000:00010000:1.0:1790779039.691803:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.691911:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790779039.691917:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603976c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+6:13733:x1877767663757312:12345-0@lo:104: Request processed in 129us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779039.691924:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790779039.691970:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790779039.691977:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+5:13733:x1877767663757440:12345-0@lo:104: 00010000:00010000:1.0:1790779039.691984:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692018:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790779039.692023:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+5:13733:x1877767663757440:12345-0@lo:104: Request processed in 48us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779039.692028:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790779039.692053:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790779039.692129:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+4:13733:x1877767663757568:12345-0@lo:104: 00010000:00010000:1.0:1790779039.692138:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692172:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790779039.692177:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+4:13733:x1877767663757568:12345-0@lo:104: Request processed in 120us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779039.692183:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790779039.692196:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790779039.692202:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:13733:x1877767663757696:12345-0@lo:104: 00010000:00010000:1.0:1790779039.692209:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692233:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790779039.692238:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3110940-f102-4234-a689-7d64ccf7427e+3:13733:x1877767663757696:12345-0@lo:104: Request processed in 38us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779039.692244:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1790779039.692261:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790779039.692267:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692274:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768800 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779039.692278:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692286:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779039.692305:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779039.692311:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790779039.692359:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692367:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779039.692387:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692394:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718768800/0xb1aa4014e936ccb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ccba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692407:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790779039.692410:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692416:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779039.692429:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692436:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779039.692442:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779039.692448:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790779039.692469:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692475:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779039.692491:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692498:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718768000/0xb1aa4014e936cca5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936ccac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692519:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790779039.692523:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692528:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce800 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779039.692531:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692538:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779039.692544:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779039.692549:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790779039.692562:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692567:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779039.692573:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692589:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77055ce800/0xb1aa4014e936cc97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692597:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779039.692600:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692606:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768a00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779039.692609:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692615:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779039.692621:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779039.692626:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790779039.692638:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692643:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779039.692649:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692656:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936cc89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936cc90 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.692668:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779039.692674:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779039.692676:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779039.692683:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779039.692703:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663757824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779039.692737:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779039.692768:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779039.692774:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663758208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779039.692794:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779039.692821:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663757952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779039.692841:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779039.692855:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779039.692860:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663758080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779039.692898:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779039.692925:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663757824 00000100:00100000:1.0:1790779039.692929:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663757824 00010000:00010000:1.0:1790779039.692948:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ccba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ccb3 expref: 24 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779039.692963:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663758208 00000100:00100000:1.0:1790779039.692965:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663758208 00010000:00010000:1.0:1790779039.692974:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cc90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc89 expref: 25 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779039.692983:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663757952 00000100:00100000:1.0:1790779039.692986:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663757952 00010000:00010000:1.0:1790779039.692996:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ccac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cca5 expref: 26 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779039.693005:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663758080 00000100:00100000:1.0:1790779039.693008:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663758080 00010000:00010000:1.0:1790779039.693025:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cc9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc97 expref: 27 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779039.693037:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790779039.693043:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+27:3652:x1877767663757824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779039.693052:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779039.693225:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779039.693239:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790779039.693254:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+27:3652:x1877767663758208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790779039.693262:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779039.693266:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cc90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc89 expref: 27 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.693275:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cc90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936cc89 expref: 27 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.693291:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779039.693333:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+27:3652:x1877767663758208:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779039.693340:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790779039.693356:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790779039.693362:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+26:3649:x1877767663757952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790779039.693368:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779039.693372:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ccac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cca5 expref: 26 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.693380:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ccac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936cca5 expref: 26 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.693390:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779039.693416:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+26:3649:x1877767663757952:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779039.693422:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790779039.693434:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790779039.693439:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+25:3649:x1877767663758080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790779039.693447:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779039.693456:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cc9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936cc97 expref: 25 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.693465:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cc9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936cc97 expref: 25 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.693473:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779039.693494:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+25:3649:x1877767663758080:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779039.693512:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790779039.693550:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663758080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779039.693558:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663757952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779039.693583:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663758208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779039.695217:0:13733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757312:0@lo:104: 00010000:00010000:2.0:1790779039.695231:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ccac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936cca5 expref: 24 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779039.695247:0:13733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757440:0@lo:104: 00010000:00010000:2.0:1790779039.695256:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769200/0xb1aa4014e936cc9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936cc97 expref: 23 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779039.695263:0:13733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757568:0@lo:104: 00010000:00010000:2.0:1790779039.695288:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769000/0xb1aa4014e936cc90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936cc89 expref: 22 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779039.695296:0:13733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757696:0@lo:104: 00010000:00010000:1.0:1790779039.695576:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ccba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936ccb3 expref: 27 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.695591:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ccba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936ccb3 expref: 21 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.695608:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ccba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936ccb3 expref: 21 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779039.695619:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779039.695727:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3110940-f102-4234-a689-7d64ccf7427e+20:3652:x1877767663757824:12345-0@lo:103:ldlm_bl.0 Request processed in 2682us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779039.695736:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790779039.695794:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663757824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779039.697665:0:13733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757056:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779039.697677:0:13733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1877767663757184:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779039.697709:0:13733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779039.698091:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779039.698169:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779039.698813:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642703488 00000100:00100000:0.0:1790779039.698822:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642703488 00010000:00010000:0.0:1790779039.698858:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e7e00/0xb1aa4014e936ccc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425733 expref: 13 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779039.699170:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642703616 00000100:00100000:0.0:1790779039.699174:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642703616 00010000:00010000:0.0:1790779039.699188:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ccc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42572c expref: 14 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779039.699208:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1790779039.699217:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0f5e17b-8b38-4652-af67-f49e83fcd571+14:2399:x1877767642703488:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779039.699231:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779039.699251:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e7e00/0xb1aa4014e936ccc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425733 expref: 14 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699264:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e7e00/0xb1aa4014e936ccc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425733 expref: 14 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699281:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e7e00/0xb1aa4014e936ccc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425733 expref: 14 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699296:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779039.699355:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642703488:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 139us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779039.699363:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1790779039.699382:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:0.0:1790779039.699389:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:2399:x1877767642703616:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779039.699396:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779039.699401:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ccc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42572c expref: 12 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699411:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ccc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42572c expref: 12 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699421:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ccc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42572c expref: 12 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699443:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699452:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699475:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699482:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699489:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699496:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699514:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779039.699519:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699527:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699540:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779039.699549:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779039.699568:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:2399:x1877767642703616:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 180us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779039.699575:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00010000:00010000:2.0:1790779039.700702:0:13733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.700715:0:13733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779039.700722:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894b200/0xb1aa4014e936ce03 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790779040.519741:0:13782:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce88f9b60 20000000:00000080:1.0:1790779040.519757:0:13782:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b7603b59400 uarg=0000000000000000 20000000:01000000:1.0:1790779040.519798:0:13782:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1790779040.519804:0:13782:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1790779040.519808:0:13782:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1790779040.520408:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1790779040.520569:0:13782:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1790779040.520701:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1790779040.520729:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1790779040.520757:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1790779040.520768:0:13782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790779040.520787:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ce0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.520804:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ce0a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.520815:0:13782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ce0a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.520822:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ce0a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.520829:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ce0a lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.520837:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ce0a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.520843:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cf000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779040.520847:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ce0a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.520856:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ce0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.520869:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ce0a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.520876:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ce0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.521040:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cf000/0xb1aa4014e936ce0a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.682920:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779040.888173:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779040.888285:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642703744 00000100:00100000:3.0:1790779040.888296:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642703744 00000100:00100000:3.0:1790779040.888357:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 337 00000100:00100000:3.0:1790779040.888365:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:6170:x1877767642703744:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779040.888380:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779040.888398:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936ce11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425780 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.888435:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936ce11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425780 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.888447:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936ce11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425780 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.888456:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e7600, rc 0) 00000100:00100000:3.0:1790779040.888532:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642703744:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 167us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779040.888540:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 337 00000100:00100000:0.0:1790779040.892749:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779040.892925:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642703872 00000100:00100000:3.0:1790779040.892934:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642703872 00000100:00100000:3.0:1790779040.892989:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 338 00000100:00100000:3.0:1790779040.892998:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642703872:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779040.893142:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642703872:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 144us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779040.893149:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 338 00000100:00100000:1.0:1790779040.896318:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779040.896385:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642704000 00000100:00100000:2.0:1790779040.896394:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642704000 00000100:00100000:2.0:1790779040.896440:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 339 00000100:00100000:2.0:1790779040.896448:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642704000:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790779040.896598:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642704000:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 150us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779040.896606:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 339 00000100:00100000:1.0:1790779040.906157:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779040.906247:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642704128 00000100:00100000:2.0:1790779040.906257:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642704128 00000100:00100000:2.0:1790779040.906312:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 340 00000100:00100000:2.0:1790779040.906333:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:10774:x1877767642704128:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779040.906481:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:10774:x1877767642704128:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 149us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779040.906490:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 340 00000100:00100000:0.0:1790779040.913998:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779040.915040:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642704256 00000100:00100000:3.0:1790779040.915051:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642704256 00000100:00100000:3.0:1790779040.915102:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 341 00000100:00100000:3.0:1790779040.915111:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:10774:x1877767642704256:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790779040.915246:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:10774:x1877767642704256:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 137us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779040.915254:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 341 00000100:00100000:1.0:1790779040.923336:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779040.924314:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642704384 00000100:00100000:3.0:1790779040.924335:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642704384 00000100:00100000:3.0:1790779040.924396:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 342 00000100:00100000:3.0:1790779040.924406:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:6170:x1877767642704384:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779040.924422:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779040.924441:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936ce18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425787 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.924469:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936ce18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425787 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.924481:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936ce18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425787 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.924500:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6200, rc 0) 00000100:00100000:3.0:1790779040.924565:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:6170:x1877767642704384:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 160us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779040.924572:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 342 00000100:00100000:1.0:1790779040.928668:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779040.928925:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642704512 00000100:00100000:2.0:1790779040.928934:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642704512 00000100:00100000:2.0:1790779040.928987:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 343 00000100:00100000:2.0:1790779040.928997:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:6170:x1877767642704512:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779040.929142:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:6170:x1877767642704512:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 146us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779040.929150:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 343 00000100:00100000:1.0:1790779040.933837:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779040.933998:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642704640 00000100:00100000:0.0:1790779040.934020:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642704640 00000100:00100000:0.0:1790779040.934075:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 344 00000100:00100000:0.0:1790779040.934085:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:6170:x1877767642704640:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779040.934220:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:6170:x1877767642704640:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 135us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779040.934228:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 344 00000100:00100000:1.0:1790779040.940717:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779040.940808:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642704768 00000100:00100000:3.0:1790779040.940819:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642704768 00000100:00100000:3.0:1790779040.940876:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 345 00000100:00100000:3.0:1790779040.940920:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:10777:x1877767642704768:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790779040.941061:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:10777:x1877767642704768:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 143us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779040.941070:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 345 00000100:00100000:1.0:1790779040.947022:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779040.947202:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642704896 00000100:00100000:2.0:1790779040.947212:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642704896 00000100:00100000:2.0:1790779040.947268:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 346 00000100:00100000:2.0:1790779040.947277:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:10777:x1877767642704896:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779040.947429:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:10777:x1877767642704896:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 152us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779040.947436:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 346 10000000:01000000:1.0:1790779041.384022:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790779041.384029:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b760310d000 from 7 10000000:01000000:1.0:1790779041.384034:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779041.384081:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.384094:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.384106:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779041.384143:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779041.384174:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663758336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779041.384206:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663758464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790779041.384272:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779041.384468:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663758336 00000100:00100000:0.0:1790779041.384480:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663758336 00000100:00100000:0.0:1790779041.384549:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790779041.384559:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663758336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779041.384603:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790779041.390210:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.391991:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779041.391998:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663758464 00000100:00100000:3.0:1790779041.392017:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663758464 00000100:00100000:0.0:1790779041.392030:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663758336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7464us (7752us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779041.392046:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790779041.392093:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1790779041.392107:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+20:6520:x1877767663758464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779041.392130:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779041.392153:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ce26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ce1f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.392190:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ce26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ce1f expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.392204:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ce26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ce1f expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.392215:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6800, rc 0) 00000100:00100000:3.0:1790779041.392283:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663758464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.392290:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1790779041.392425:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663758336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779041.392535:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663758464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779041.392579:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.392590:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779041.392707:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663758592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.392765:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.392801:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779041.392926:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663758592 00000100:00100000:3.0:1790779041.392931:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663758592 00000100:00100000:3.0:1790779041.392966:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1790779041.392974:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663758592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779041.393128:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663758592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.393135:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1790779041.393212:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663758592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779041.393245:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663758720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790779041.393293:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779041.393323:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603808f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790779041.393375:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663758720 00000100:00100000:3.0:1790779041.393380:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663758720 00000100:00100000:3.0:1790779041.393447:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1790779041.393454:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663758720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779041.393573:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663758720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.393580:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1790779041.393665:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663758720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.396145:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13796:1877767663758848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779041.396243:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.396938:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779041.397161:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663758848 00000100:00100000:2.0:1790779041.397172:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663758848 00000100:00100000:2.0:1790779041.397245:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1790779041.397257:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:13796:x1877767663758848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779041.397509:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+21:13796:x1877767663758848:12345-0@lo:502:llog_process_th.0 Request processed in 253us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779041.397518:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1790779041.397647:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13796:1877767663758848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790779041.397697:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779041.397710:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779041.397713:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790779041.397720:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b760310d000 00000020:00000080:1.0:1790779041.397723:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790779041.397802:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779041.397806:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779041.397808:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790779041.397810:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779041.397822:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779041.397824:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790779041.397827:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b760310d000 00000020:00000080:1.0:1790779041.397829:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790779041.397875:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13796:1877767663758976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779041.397953:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779041.398033:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663758976 00000100:00100000:3.0:1790779041.398038:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663758976 00000100:00100000:3.0:1790779041.398073:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1790779041.398081:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:13796:x1877767663758976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779041.398162:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+21:13796:x1877767663758976:12345-0@lo:502:llog_process_th.0 Request processed in 81us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.398169:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1790779041.399314:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779041.399347:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13796:1877767663758976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790779041.399387:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779041.399395:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779041.399398:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790779041.399403:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790779041.400806:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790779041.400856:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779041.400906:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.400922:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779041.400934:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790779041.400937:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b77344a6000 from 7 10000000:01000000:1.0:1790779041.400940:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779041.400985:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.401005:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.401018:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779041.403624:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663759104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.403731:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.403784:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779041.403938:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663759104 00000100:00100000:2.0:1790779041.403950:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663759104 00000100:00100000:2.0:1790779041.404005:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1790779041.404016:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+21:6520:x1877767663759104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779041.404037:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779041.404061:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894be00/0xb1aa4014e936ce34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ce2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779041.404096:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894be00/0xb1aa4014e936ce34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ce2d expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779041.404109:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894be00/0xb1aa4014e936ce34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ce2d expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779041.404120:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894be00, rc 0) 00000100:00100000:2.0:1790779041.404172:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663759104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779041.404181:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1790779041.404422:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663759104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779041.404462:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.404473:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779041.404585:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663759232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.404616:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.404636:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779041.404906:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663759232 00000100:00100000:2.0:1790779041.404911:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663759232 00000100:00100000:2.0:1790779041.404940:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1790779041.404948:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663759232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779041.405120:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663759232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779041.405128:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1790779041.405389:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663759232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.405428:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663759360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.405479:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.405513:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779041.405865:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663759360 00000100:00100000:2.0:1790779041.405870:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663759360 00000100:00100000:2.0:1790779041.405937:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1790779041.405946:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663759360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790779041.406072:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663759360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779041.406079:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1790779041.407211:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663759360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.410634:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13798:1877767663759488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779041.410742:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.410798:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1000 going to sleep for 11 seconds 00000100:00100000:2.0:1790779041.410937:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663759488 00000100:00100000:2.0:1790779041.410947:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663759488 00000100:00100000:2.0:1790779041.411013:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1790779041.411025:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:13798:x1877767663759488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779041.411195:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+22:13798:x1877767663759488:12345-0@lo:502:llog_process_th.0 Request processed in 172us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779041.411204:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1790779041.412873:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13798:1877767663759488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790779041.412941:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779041.412953:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779041.412956:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790779041.412970:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b77344a6000 00000020:00000080:3.0:1790779041.412973:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779041.413051:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779041.413054:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779041.413056:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790779041.413059:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779041.413061:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779041.413063:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790779041.413066:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b77344a6000 00000020:00000080:3.0:1790779041.413068:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790779041.413124:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13798:1877767663759616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779041.413199:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779041.413242:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027f1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779041.415685:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663759616 00000100:00100000:1.0:1790779041.415706:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663759616 00000100:00100000:1.0:1790779041.415786:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1790779041.415803:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:13798:x1877767663759616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779041.416055:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:13798:x1877767663759616:12345-0@lo:502:llog_process_th.0 Request processed in 253us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779041.416064:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1790779041.416974:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13798:1877767663759616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790779041.417026:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779041.417038:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779041.417041:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790779041.417045:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790779041.417292:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1790779041.417319:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790779041.417334:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.417348:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779041.417362:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790779041.417366:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7712708000 from 7 10000000:01000000:3.0:1790779041.417369:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790779041.417416:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.417424:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.417435:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779041.417471:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663759744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790779041.417547:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779041.417601:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779041.417773:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663759744 00000100:00100000:0.0:1790779041.417782:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663759744 00000100:00100000:0.0:1790779041.417850:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1790779041.417860:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+22:6520:x1877767663759744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779041.417875:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779041.417917:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768600/0xb1aa4014e936ce42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ce3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779041.417957:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768600/0xb1aa4014e936ce42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ce3b expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779041.417969:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768600/0xb1aa4014e936ce42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ce3b expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779041.417979:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768600, rc 0) 00000100:00100000:0.0:1790779041.418029:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663759744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779041.418035:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1790779041.418681:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663759744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779041.418702:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.418713:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779041.418821:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663759872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779041.418860:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779041.418912:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779041.419298:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663759872 00000100:00100000:0.0:1790779041.419305:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663759872 00000100:00100000:0.0:1790779041.419352:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1790779041.419362:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663759872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779041.419543:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663759872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779041.419551:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1790779041.423500:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663759872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779041.423586:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663760000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779041.423688:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779041.423732:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779041.423918:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663760000 00000100:00100000:0.0:1790779041.423926:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663760000 00000100:00100000:0.0:1790779041.423995:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1790779041.424006:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663760000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779041.424162:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663760000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779041.424170:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1790779041.424350:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663760000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779041.424802:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13800:1877767663760128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779041.424847:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779041.424909:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027f1780 going to sleep for 11 seconds 00000100:00100000:0.0:1790779041.425047:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663760128 00000100:00100000:0.0:1790779041.425053:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663760128 00000100:00100000:0.0:1790779041.425096:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1790779041.425104:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:13800:x1877767663760128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779041.425210:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+23:13800:x1877767663760128:12345-0@lo:502:llog_process_th.0 Request processed in 106us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779041.425217:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1790779041.425396:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13800:1877767663760128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790779041.425425:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779041.425438:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779041.425441:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790779041.425466:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b7712708000 00000020:00000080:3.0:1790779041.425469:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779041.425552:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779041.425556:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779041.425557:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790779041.425561:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779041.425563:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779041.425565:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790779041.425569:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b7712708000 00000020:00000080:3.0:1790779041.425571:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790779041.425611:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13800:1877767663760256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779041.425646:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779041.425669:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663760256 00000100:00100000:3.0:1790779041.425673:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663760256 00000100:00100000:3.0:1790779041.425698:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1790779041.425704:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:13800:x1877767663760256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779041.425769:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+23:13800:x1877767663760256:12345-0@lo:502:llog_process_th.0 Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.425775:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1790779041.425951:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027f1780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779041.425963:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13800:1877767663760256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790779041.425980:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779041.425984:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779041.425986:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790779041.426052:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790779041.426969:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790779041.427016:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779041.427031:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.427044:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779041.427056:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790779041.427060:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b77208a9000 from 7 10000000:01000000:1.0:1790779041.427063:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779041.427103:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.427113:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.427125:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779041.427147:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663760384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.427217:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.427256:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779041.427670:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663760384 00000100:00100000:3.0:1790779041.427678:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663760384 00000100:00100000:3.0:1790779041.427729:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1790779041.427738:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+23:6520:x1877767663760384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779041.427752:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779041.427768:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ce50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ce49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.427862:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ce50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ce49 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.427900:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ce50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ce49 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.427924:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e6c00, rc 0) 00000100:00100000:3.0:1790779041.427978:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663760384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.427986:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1790779041.428180:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663760384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779041.428197:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.428206:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779041.428272:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663760512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.428304:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.428334:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779041.428373:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663760512 00000100:00100000:3.0:1790779041.428377:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663760512 00000100:00100000:3.0:1790779041.428405:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1790779041.428413:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663760512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779041.428644:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663760512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.428651:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1790779041.428705:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663760512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.428732:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663760640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.428770:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.428908:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779041.433082:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663760640 00000100:00100000:0.0:1790779041.433099:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663760640 00000100:00100000:0.0:1790779041.433162:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1790779041.433170:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663760640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779041.433371:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:6520:x1877767663760640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (4600us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779041.433378:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000040:00080000:0.0:1790779041.435434:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790779041.436040:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3110940-f102-4234-a689-7d64ccf7427e:6520:1877767663760640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790779041.436696:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13802:1877767663760768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779041.436796:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779041.436851:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603808540 going to sleep for 11 seconds 00000100:00100000:3.0:1790779041.436919:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663760768 00000100:00100000:3.0:1790779041.436927:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663760768 00000100:00100000:3.0:1790779041.436984:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1790779041.436994:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:13802:x1877767663760768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779041.437138:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:13802:x1877767663760768:12345-0@lo:502:llog_process_th.0 Request processed in 145us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.437147:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1790779041.437211:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13802:1877767663760768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790779041.437242:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779041.437254:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779041.437263:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790779041.437271:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b77208a9000 00000020:00000080:2.0:1790779041.437275:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790779041.437347:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779041.437351:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779041.437353:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790779041.437356:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779041.437358:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779041.437360:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790779041.437363:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b77208a9000 00000020:00000080:2.0:1790779041.437365:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790779041.437400:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13802:1877767663760896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779041.437521:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779041.437556:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603808540 going to sleep for 11 seconds 00000100:00100000:3.0:1790779041.437747:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663760896 00000100:00100000:3.0:1790779041.437752:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663760896 00000100:00100000:3.0:1790779041.437787:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1790779041.437795:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:13802:x1877767663760896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779041.437904:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:13802:x1877767663760896:12345-0@lo:502:llog_process_th.0 Request processed in 109us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.437911:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1790779041.439594:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3110940-f102-4234-a689-7d64ccf7427e:13802:1877767663760896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790779041.439633:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779041.439640:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779041.439642:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790779041.439646:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790779041.439734:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1790779041.439766:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790779041.439779:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.439791:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779041.461432:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779041.704590:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779041.973697:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779041.973741:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779041.973772:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779041.973792:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779041.973808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779041.973827:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779041.973964:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642705280 00000100:00100000:2.0:1790779041.973984:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642705280 00000100:00100000:3.0:1790779041.974024:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642705024 00000100:00100000:3.0:1790779041.974035:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642705024 00000100:00100000:2.0:1790779041.974094:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642705536 00000100:00100000:2.0:1790779041.974100:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642705536 00000100:00100000:3.0:1790779041.974107:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 367 00000100:00100000:3.0:1790779041.974122:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642705024:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779041.974133:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642705152 00000100:00100000:2.0:1790779041.974139:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642705152 00000100:00100000:2.0:1790779041.974176:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642705664 00000100:00100000:2.0:1790779041.974180:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642705664 00000100:00100000:3.0:1790779041.974202:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642705024:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 81us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779041.974212:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00100000:3.0:1790779041.974222:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 367 00000100:00100000:2.0:1790779041.974232:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642705280:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779041.974272:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00100000:3.0:1790779041.974284:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642705536:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779041.974343:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642705280:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 117us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779041.974355:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00080000:0.0:1790779041.974359:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779041.974368:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779041.974383:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 213 00000100:00100000:2.0:1790779041.974392:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642705152:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779041.974724:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 214 00000100:00100000:0.0:1790779041.974738:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642705664:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779041.975087:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642705536:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 805us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.975096:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00100000:3.0:1790779041.975141:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642705408 00000100:00100000:3.0:1790779041.975147:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642705408 00000100:00100000:3.0:1790779041.975189:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:3.0:1790779041.975197:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642705408:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779041.975226:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642705408:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.975247:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00080000:3.0:1790779041.975263:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779041.975545:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642705152:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1146us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779041.975557:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 213 00000100:00100000:0.0:1790779041.976855:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642705664:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 2113us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779041.976866:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 214 00000040:00080000:1.0:1790779042.472524:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1790779042.474306:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790779042.728044:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779042.920197:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76035c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663761024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779042.920268:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779042.920272:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663761152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779042.920314:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779042.920412:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663761024 00000100:00100000:2.0:1790779042.920420:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663761024 00000100:00100000:0.0:1790779042.920461:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663761152 00000100:00100000:0.0:1790779042.920467:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663761152 00000100:00100000:2.0:1790779042.920501:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790779042.920508:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790779042.920513:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663761024:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779042.920522:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1877767663761152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790779042.920546:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1790779042.920547:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779042.920606:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663761024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779042.920616:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790779042.920617:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1877767663761152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779042.920626:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790779042.920666:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76035c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663761024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779042.920681:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663761152:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790779042.920788:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790779043.752557:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779043.945716:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663761536:0@lo:400:kworker.0 00000100:00100000:1.0:1790779043.945794:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779043.945867:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663762048:0@lo:400:kworker.0 00000100:00100000:1.0:1790779043.945916:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779043.945929:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663762560:0@lo:400:kworker.0 00000100:00100000:1.0:1790779043.945945:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779043.945972:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790779043.945979:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663761664:0@lo:400:kworker.0 00000100:00100000:1.0:1790779043.946001:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779043.946017:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663762176:0@lo:400:kworker.0 00000100:00100000:1.0:1790779043.946037:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779043.946052:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663762688:0@lo:400:kworker.0 00000100:00100000:1.0:1790779043.946087:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779043.946160:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663761536 00000100:00100000:2.0:1790779043.946167:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663761536 00000100:00100000:2.0:1790779043.946208:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790779043.946214:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663761536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779043.946258:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663761536:12345-0@lo:400:kworker.0 Request processed in 44us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779043.946263:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790779043.946327:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663761536:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946437:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663761280:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946483:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779043.946516:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663761792:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946534:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779043.946547:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663762304:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946558:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779043.946567:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663762816:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946578:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779043.946589:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790779043.946593:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663761408:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946604:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779043.946612:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663761920:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946622:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779043.946630:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663762432:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946640:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779043.946654:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663762176 00000100:00100000:3.0:1790779043.946658:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663762176 00000100:00100000:3.0:1790779043.946677:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663762688 00000100:00100000:3.0:1790779043.946680:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663762688 00000100:00100000:3.0:1790779043.946700:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663762304 00000100:00100000:3.0:1790779043.946708:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663762304 00000100:00100000:3.0:1790779043.946727:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663762816 00000100:00100000:3.0:1790779043.946730:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663762816 00000100:00100000:3.0:1790779043.946744:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790779043.946749:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663762176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946785:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663762176:12345-0@lo:400:kworker.0 Request processed in 35us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779043.946792:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790779043.946804:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790779043.946809:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663762688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946835:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663762688:12345-0@lo:400:kworker.0 Request processed in 26us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779043.946840:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790779043.946856:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790779043.946863:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663762304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946912:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663762304:12345-0@lo:400:kworker.0 Request processed in 49us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779043.946918:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790779043.946930:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790779043.946935:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663762816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.946975:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663762816:12345-0@lo:400:kworker.0 Request processed in 40us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779043.946981:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790779043.946998:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663762048 00000100:00100000:3.0:1790779043.947001:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663762048 00000100:00100000:3.0:1790779043.947020:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663762560 00000100:00100000:3.0:1790779043.947022:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663762560 00000100:00100000:3.0:1790779043.947043:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663761664 00000100:00100000:3.0:1790779043.947046:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663761664 00000100:00100000:3.0:1790779043.947055:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663761408 00000100:00100000:3.0:1790779043.947057:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663761408 00000100:00100000:3.0:1790779043.947064:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663761920 00000100:00100000:3.0:1790779043.947067:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663761920 00000100:00100000:3.0:1790779043.947077:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663762432 00000100:00100000:3.0:1790779043.947079:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663762432 00000100:00100000:3.0:1790779043.947096:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1790779043.947102:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663762048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947131:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663762048:12345-0@lo:400:kworker.0 Request processed in 30us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779043.947137:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1790779043.947147:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1790779043.947152:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663762560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947177:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663762560:12345-0@lo:400:kworker.0 Request processed in 25us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779043.947182:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1790779043.947193:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1790779043.947198:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663761664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947223:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663761664:12345-0@lo:400:kworker.0 Request processed in 24us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779043.947229:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1790779043.947239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1790779043.947245:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663761408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947269:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663761408:12345-0@lo:400:kworker.0 Request processed in 25us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779043.947283:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1790779043.947295:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790779043.947301:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663761920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947328:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663761920:12345-0@lo:400:kworker.0 Request processed in 28us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779043.947334:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790779043.947345:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1790779043.947350:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663762432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947373:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663762432:12345-0@lo:400:kworker.0 Request processed in 24us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779043.947379:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:3.0:1790779043.947402:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790779043.947406:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779043.947408:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779043.947420:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663761792 00000100:00100000:3.0:1790779043.947424:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663761792 00000100:00100000:3.0:1790779043.947443:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790779043.947448:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663761792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947487:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663761792:12345-0@lo:400:kworker.0 Request processed in 39us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779043.947493:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790779043.947527:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663761408:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947537:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663761920:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947544:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663762432:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947565:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663761792:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947573:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663762304:0@lo:400:kworker.0 00010000:00080000:3.0:1790779043.947584:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d6a00 x1877767663762816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779043.947594:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663762816:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947627:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663761664:0@lo:400:kworker.0 00000100:00100000:3.0:1790779043.947637:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663762176:0@lo:400:kworker.0 00010000:00080000:3.0:1790779043.947646:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d5500 x1877767663762688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779043.947655:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663762688:0@lo:400:kworker.0 00010000:00080000:3.0:1790779043.947664:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4c4700 x1877767663762048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779043.947673:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663762048:0@lo:400:kworker.0 00010000:00080000:3.0:1790779043.947682:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4d5180 x1877767663762560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779043.947693:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663762560:0@lo:400:kworker.0 00000100:00100000:0.0:1790779043.947910:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663762944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779043.947946:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779043.948003:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790779043.948011:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76035c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663763072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779043.948046:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779043.948073:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663762944 00000100:00100000:0.0:1790779043.948077:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663762944 00000100:00100000:0.0:1790779043.948099:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663763072 00000100:00100000:0.0:1790779043.948101:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663763072 00000100:00100000:0.0:1790779043.948112:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790779043.948118:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663762944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779043.948139:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779043.948173:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663762944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779043.948179:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790779043.948191:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790779043.948204:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663763072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779043.948214:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779043.948240:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663763072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779043.948246:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1790779043.948268:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4f6300 x1877767663762944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1790779043.948982:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76035c7800 x1877767663763072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779043.948997:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76035c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663763072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779043.949068:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663762944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779043.949140:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663761280 00000100:00100000:2.0:1790779043.949152:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663761280 00000100:00100000:2.0:1790779043.949189:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1790779043.949197:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663761280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779043.949241:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663761280:12345-0@lo:400:kworker.0 Request processed in 46us (2758us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779043.949248:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1790779043.949589:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663761280:0@lo:400:kworker.0 00000100:00100000:3.0:1790779044.457412:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779044.457437:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76035c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663763200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779044.457521:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779044.457838:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663763200 00000100:00100000:2.0:1790779044.457846:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663763200 00000100:00100000:2.0:1790779044.457932:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790779044.457943:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663763200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790779044.457977:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790779044.458037:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663763200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779044.458043:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790779044.462102:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76035c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663763200:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790779044.779145:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790779044.971333:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1790779045.800075:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779046.505354:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779046.505376:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663763328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779046.505446:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779046.505734:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663763328 00000100:00100000:2.0:1790779046.505744:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663763328 00000100:00100000:2.0:1790779046.505798:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790779046.505808:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663763328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779046.505841:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790779046.505968:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663763328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779046.505975:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790779046.507716:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663763328:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790779046.824107:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779047.096290:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779047.096344:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779047.096377:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779047.096399:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779047.096419:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779047.096639:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642706048 00000100:00100000:2.0:1790779047.096661:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642706048 00000100:00100000:2.0:1790779047.096745:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642706304 00000100:00100000:2.0:1790779047.096749:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642706304 00000100:00100000:1.0:1790779047.096762:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642705920 00000100:00100000:1.0:1790779047.096772:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642705920 00000100:00100000:2.0:1790779047.096789:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:2.0:1790779047.096820:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642706048:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779047.096832:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:1.0:1790779047.096845:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642706304:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779047.096958:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642706048:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 140us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779047.096971:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642706304:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 126us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779047.096972:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:0.0:1790779047.097104:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779047.097139:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642706432 00000100:00100000:2.0:1790779047.097145:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642706432 00000100:00100000:3.0:1790779047.097234:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642705792 00000100:00100000:3.0:1790779047.097252:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642705792 00000100:00100000:3.0:1790779047.097293:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 369 00000100:00100000:3.0:1790779047.097301:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642705792:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779047.097331:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642705792:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 32us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779047.097337:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 369 00000100:00080000:0.0:1790779047.097581:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779047.097586:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790779047.097600:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642706176 00000100:00100000:0.0:1790779047.097604:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642706176 00000100:00100000:0.0:1790779047.097644:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 86 00000100:00100000:0.0:1790779047.097652:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642706176:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779047.097689:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642706176:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 38us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779047.097696:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 86 00000100:00100000:1.0:1790779047.099890:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:1.0:1790779047.099953:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 223 00000100:00100000:1.0:1790779047.099975:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642705920:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779047.100069:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642705920:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 106us (3669us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779047.100076:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 223 00000100:00100000:2.0:1790779047.102351:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 224 00000100:00100000:2.0:1790779047.102381:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642706432:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779047.102474:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642706432:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 110us (5370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779047.102483:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 224 00000100:00080000:2.0:1790779047.102560:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790779047.848163:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779048.040538:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779048.040647:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663763456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779048.040828:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779048.040963:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663763584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779048.041076:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779048.056775:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663763456 00000100:00100000:2.0:1790779048.056797:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663763456 00000100:00100000:2.0:1790779048.056944:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663763584 00000100:00100000:2.0:1790779048.056948:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663763584 00000100:00100000:1.0:1790779048.057041:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790779048.057080:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663763456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790779048.057114:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779048.057251:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663763456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (16423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779048.057265:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1790779048.068336:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779048.069803:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663763456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779048.070825:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790779048.070839:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663763584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790779048.070865:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779048.071008:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663763584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (29933us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779048.071016:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790779048.071215:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1790779048.071222:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b772ff32d80, transno 4294967301 00000100:00100000:3.0:1790779048.071248:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663763584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790779048.874639:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779049.064304:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779049.064327:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663763712:0@lo:400:kworker.0 00000100:00100000:2.0:1790779049.064375:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663763840:0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.064403:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779049.064419:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779049.064477:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779049.064499:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772ff32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663763968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779049.064510:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779049.064525:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663764096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779049.064543:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779049.064583:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663763840 00000100:00100000:1.0:1790779049.064590:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779049.064592:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663763840 00000100:00100000:1.0:1790779049.064640:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663763712 00000100:00100000:2.0:1790779049.064644:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1790779049.064647:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663763712 00000100:00100000:2.0:1790779049.064653:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663763840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779049.064706:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663763840:12345-0@lo:400:kworker.0 Request processed in 53us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779049.064715:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790779049.064754:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663763840:0@lo:400:kworker.0 00000100:00100000:2.0:1790779049.064773:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663763968 00000100:00100000:2.0:1790779049.064777:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663763968 00000100:00100000:2.0:1790779049.064810:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663764096 00000100:00100000:2.0:1790779049.064814:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663764096 00000100:00100000:2.0:1790779049.064828:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790779049.064833:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663763968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790779049.064854:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779049.064907:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1790779049.064916:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663763712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779049.064953:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663763712:12345-0@lo:400:kworker.0 Request processed in 38us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779049.064961:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1790779049.065008:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790779049.065018:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663764096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790779049.065030:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779049.065065:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663764096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779049.065071:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663764480:0@lo:400:kworker.0 00000100:00100000:1.0:1790779049.065076:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790779049.065164:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779049.065194:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663764992:0@lo:400:kworker.0 00000100:00100000:3.0:1790779049.065222:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779049.065231:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663763712:0@lo:400:kworker.0 00000100:00100000:3.0:1790779049.065245:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790779049.065255:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663764608:0@lo:400:kworker.0 00000100:00100000:3.0:1790779049.065257:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663764352:0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.065288:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779049.065312:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663765120:0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.065332:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779049.065350:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790779049.065356:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663764224:0@lo:400:kworker.0 00000100:00100000:3.0:1790779049.065442:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779049.065463:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663764864:0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.065479:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779049.065494:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779049.065511:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663764736:0@lo:400:kworker.0 00000100:00100000:3.0:1790779049.065528:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663764992 00000100:00100000:3.0:1790779049.065540:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663764992 00000100:00100000:0.0:1790779049.065554:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779049.065574:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663764864 00000100:00100000:0.0:1790779049.065577:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663765248:0@lo:400:kworker.0 00000100:00100000:3.0:1790779049.065579:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663764864 00000100:00100000:3.0:1790779049.065607:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790779049.065615:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663764992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.065624:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779049.065688:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663764480 00000100:00100000:1.0:1790779049.065692:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663764480 00000100:00100000:1.0:1790779049.065710:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663764224 00000100:00100000:1.0:1790779049.065713:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663764224 00000100:00100000:1.0:1790779049.065727:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790779049.065733:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663764480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779049.065865:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663764992:12345-0@lo:400:kworker.0 Request processed in 251us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779049.065898:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790779049.065913:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790779049.065919:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663764864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779049.065951:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663764864:12345-0@lo:400:kworker.0 Request processed in 32us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779049.065957:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790779049.066019:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663764608 00000100:00100000:0.0:1790779049.066024:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663764608 00000100:00100000:0.0:1790779049.066051:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663765120 00000100:00100000:0.0:1790779049.066054:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663765120 00000100:00100000:0.0:1790779049.066074:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663764352 00000100:00100000:0.0:1790779049.066078:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663764352 00000100:00100000:0.0:1790779049.066095:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663764736 00000100:00100000:0.0:1790779049.066098:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663764736 00000100:00100000:0.0:1790779049.066115:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663765248 00000100:00100000:0.0:1790779049.066126:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663765248 00000100:00100000:0.0:1790779049.066150:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790779049.066156:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663764608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.066269:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663764608:12345-0@lo:400:kworker.0 Request processed in 113us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779049.066276:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790779049.066290:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790779049.066295:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663765120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.066324:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663765120:12345-0@lo:400:kworker.0 Request processed in 29us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779049.066329:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790779049.066341:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1790779049.066346:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663764352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.066405:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663764352:12345-0@lo:400:kworker.0 Request processed in 59us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779049.066411:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1790779049.066424:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1790779049.066452:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663764736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.066485:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663764736:12345-0@lo:400:kworker.0 Request processed in 56us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779049.066491:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1790779049.066503:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790779049.066509:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663765248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.066566:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663765248:12345-0@lo:400:kworker.0 Request processed in 57us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779049.066580:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00010000:00080000:0.0:1790779049.066630:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ece00 x1877767663764736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779049.066644:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663764736:0@lo:400:kworker.0 00010000:00080000:0.0:1790779049.066680:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603beca80 x1877767663765248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779049.066689:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663765248:0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.066698:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663764608:0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.066707:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663765120:0@lo:400:kworker.0 00010000:00080000:0.0:1790779049.066788:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4f5c00 x1877767663764096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779049.066802:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663764096:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790779049.066821:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790779049.066825:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779049.066828:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779049.066864:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663764352:0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.066875:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663764864:0@lo:400:kworker.0 00000100:00100000:0.0:1790779049.066947:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663764992:0@lo:400:kworker.0 00000100:00100000:2.0:1790779049.071706:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663763968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6861us (7153us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779049.071720:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790779049.072668:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663764480:12345-0@lo:400:kworker.0 Request processed in 6929us (7498us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779049.072701:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790779049.072728:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790779049.072741:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663764224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779049.072810:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663764224:12345-0@lo:400:kworker.0 Request processed in 74us (7332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779049.072816:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790779049.072863:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663764224:0@lo:400:kworker.0 00000100:00100000:2.0:1790779049.073451:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663764480:0@lo:400:kworker.0 00010000:00080000:0.0:1790779049.075012:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b772ff32680 x1877767663763968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779049.075038:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772ff32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663763968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779049.578160:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779049.578185:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663765376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779049.578257:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779049.578921:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663765376 00000100:00100000:0.0:1790779049.578931:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663765376 00000100:00100000:0.0:1790779049.578988:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790779049.578998:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663765376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779049.579034:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790779049.579103:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663765376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779049.579111:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790779049.579491:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663765376:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790779049.898632:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779050.921094:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779051.624540:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663765504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779051.624650:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779051.625492:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663765504 00000100:00100000:0.0:1790779051.625505:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663765504 00000100:00100000:0.0:1790779051.625586:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790779051.625600:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663765504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779051.625656:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790779051.625758:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663765504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779051.625766:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790779051.625916:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663765504:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790779051.945032:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779052.213142:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779052.213189:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779052.213217:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779052.213254:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779052.213274:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779052.213300:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779052.213335:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642706688 00000100:00100000:0.0:1790779052.213343:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642706688 00000100:00100000:0.0:1790779052.213401:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642707200 00000100:00100000:0.0:1790779052.213404:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642707200 00000100:00100000:0.0:1790779052.213427:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642706816 00000100:00100000:0.0:1790779052.213443:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642706816 00000100:00100000:0.0:1790779052.213463:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642707072 00000100:00100000:0.0:1790779052.213465:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642707072 00000100:00100000:0.0:1790779052.213481:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 231 00000100:00100000:0.0:1790779052.213489:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642706688:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779052.213559:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642706688:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 69us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779052.213566:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 231 00000100:00100000:0.0:1790779052.213583:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00100000:0.0:1790779052.213590:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642707200:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779052.213615:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642707200:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779052.213621:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00100000:0.0:1790779052.213634:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 233 00000100:00100000:0.0:1790779052.213639:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642706816:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779052.214031:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642706944 00000100:00100000:1.0:1790779052.214035:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642706944 00000100:00100000:1.0:1790779052.214072:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:1.0:1790779052.214079:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642706944:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779052.214108:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642706944:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779052.214113:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:1.0:1790779052.214152:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 234 00000100:00100000:1.0:1790779052.214159:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642707072:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779052.214184:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642707072:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779052.214189:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 234 00000100:00080000:1.0:1790779052.214207:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790779052.214211:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790779052.214213:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779052.214505:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642706816:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 864us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779052.214513:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 233 00000100:00100000:2.0:1790779052.215545:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642706560 00000100:00100000:2.0:1790779052.215554:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642706560 00000100:00100000:2.0:1790779052.215601:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 371 00000100:00100000:2.0:1790779052.215610:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2398:x1877767642706560:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779052.215693:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2398:x1877767642706560:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 75us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779052.215701:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 371 00000040:00080000:0.0:1790779052.712989:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790779052.715995:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790779052.968603:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779053.160517:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790779053.160553:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663765632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779053.160618:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779053.160694:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663765760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779053.160718:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779053.160862:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663765632 00000100:00100000:1.0:1790779053.160871:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663765632 00000100:00100000:1.0:1790779053.160951:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663765760 00000100:00100000:1.0:1790779053.160954:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663765760 00000100:00100000:1.0:1790779053.160972:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790779053.160980:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663765632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779053.161007:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779053.161052:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663765632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779053.161059:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790779053.161074:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790779053.161082:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663765760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790779053.161091:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779053.161114:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663765760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779053.161119:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1790779053.161445:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779053.161494:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663765632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779053.161509:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663765760:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790779053.992604:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779054.185461:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779054.185486:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663765888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779054.185553:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.193033:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663766016:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.193103:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.193150:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663766528:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.193175:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.193198:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663767040:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.193234:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.193253:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663767552:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.193273:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.193295:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790779054.193301:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663766144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779054.193334:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.193353:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663766656:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.193372:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.193386:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663767168:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.193417:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.193447:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663766016 00000100:00100000:0.0:1790779054.193455:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663766016 00000100:00100000:0.0:1790779054.193496:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1790779054.193504:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663766016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.193550:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663766016:12345-0@lo:400:kworker.0 Request processed in 46us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.193557:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1790779054.193916:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663767040 00000100:00100000:0.0:1790779054.193920:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663767040 00000100:00100000:0.0:1790779054.193943:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663767552 00000100:00100000:0.0:1790779054.193946:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663767552 00000100:00100000:0.0:1790779054.193964:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663767168 00000100:00100000:0.0:1790779054.193966:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663767168 00000100:00100000:0.0:1790779054.193978:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790779054.193983:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663767040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.194017:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663767040:12345-0@lo:400:kworker.0 Request processed in 33us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.194022:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790779054.194034:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790779054.194039:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663767552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.194066:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663767552:12345-0@lo:400:kworker.0 Request processed in 26us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.194072:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790779054.194086:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790779054.194092:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663767168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.194120:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663767168:12345-0@lo:400:kworker.0 Request processed in 29us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.194126:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790779054.194149:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663765888 00000100:00100000:0.0:1790779054.194154:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663766144 00000100:00100000:2.0:1790779054.194156:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663765888 00000100:00100000:0.0:1790779054.194159:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663766144 00000100:00100000:0.0:1790779054.194189:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790779054.194196:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663766144:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779054.194206:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790779054.194218:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663765888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779054.194230:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779054.194263:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663766144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.194275:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1790779054.194293:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779054.194319:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663766656 00000100:00100000:0.0:1790779054.194322:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663766656 00000100:00100000:0.0:1790779054.194345:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790779054.194350:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663766656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.194385:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663766656:12345-0@lo:400:kworker.0 Request processed in 34us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.194390:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:0.0:1790779054.194439:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4f4700 x1877767663766144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779054.194456:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663766144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779054.194466:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663766656:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.194475:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663767168:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.194483:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663766016:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.194492:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663767040:0@lo:400:kworker.0 00010000:00080000:0.0:1790779054.194499:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041a4380 x1877767663767552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779054.194505:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663767552:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.194547:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663766528 00000100:00100000:0.0:1790779054.194551:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663766528 00002000:00000024:2.0:1790779054.194577:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779054.194594:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790779054.194603:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663766528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779054.194617:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663765888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 400us (9061us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.194657:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663766528:12345-0@lo:400:kworker.0 Request processed in 55us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.194664:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1790779054.194696:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790779054.194909:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663766400:0@lo:400:kworker.0 00000100:00100000:2.0:1790779054.194943:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779054.194965:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663766912:0@lo:400:kworker.0 00000100:00100000:2.0:1790779054.194987:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779054.195002:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663767424:0@lo:400:kworker.0 00000100:00100000:2.0:1790779054.195021:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779054.195037:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790779054.195043:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663766272:0@lo:400:kworker.0 00000100:00100000:2.0:1790779054.195062:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779054.195080:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663766784:0@lo:400:kworker.0 00000100:00100000:2.0:1790779054.195098:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779054.195109:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663767296:0@lo:400:kworker.0 00000100:00100000:2.0:1790779054.195128:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779054.195159:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663766912 00000100:00100000:2.0:1790779054.195163:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663766912 00000100:00100000:1.0:1790779054.197135:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663767424 00000100:00100000:1.0:1790779054.197146:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663767424 00000100:00100000:1.0:1790779054.197183:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663766272 00000100:00100000:1.0:1790779054.197185:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663766272 00000100:00100000:1.0:1790779054.197194:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663766784 00000100:00100000:1.0:1790779054.197197:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663766784 00000100:00100000:1.0:1790779054.197207:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663767296 00000100:00100000:1.0:1790779054.197209:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663767296 00000100:00100000:1.0:1790779054.197237:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790779054.197245:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663766912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779054.197331:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663766912:12345-0@lo:400:kworker.0 Request processed in 87us (2342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779054.197352:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790779054.197376:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1790779054.197381:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663767424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779054.197428:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663767424:12345-0@lo:400:kworker.0 Request processed in 46us (2406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779054.197433:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1790779054.197445:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1790779054.197451:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663766272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779054.197474:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663766272:12345-0@lo:400:kworker.0 Request processed in 24us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779054.197479:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1790779054.197487:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1790779054.197492:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663766784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779054.197512:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663766784:12345-0@lo:400:kworker.0 Request processed in 20us (2413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779054.197517:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1790779054.197525:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1790779054.197530:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663767296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779054.197550:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663767296:12345-0@lo:400:kworker.0 Request processed in 20us (2422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779054.197554:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1790779054.197608:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663766528:0@lo:400:kworker.0 00000100:00080000:1.0:1790779054.197649:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790779054.197653:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779054.197675:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663766400 00000100:00100000:1.0:1790779054.197679:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663766400 00000100:00100000:1.0:1790779054.197705:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790779054.197713:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663766400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779054.197905:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663766400:12345-0@lo:400:kworker.0 Request processed in 191us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779054.197911:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790779054.197966:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663766272:0@lo:400:kworker.0 00000100:00100000:1.0:1790779054.197977:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663766784:0@lo:400:kworker.0 00000100:00100000:1.0:1790779054.197986:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663767296:0@lo:400:kworker.0 00000100:00100000:1.0:1790779054.197995:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663766400:0@lo:400:kworker.0 00010000:00080000:1.0:1790779054.198006:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a41f80 x1877767663766912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779054.198016:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663766912:0@lo:400:kworker.0 00010000:00080000:1.0:1790779054.198026:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041a6300 x1877767663767424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779054.198034:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663767424:0@lo:400:kworker.0 00010000:00080000:3.0:1790779054.205779:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a41500 x1877767663765888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779054.205811:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663765888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779054.696294:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779054.696317:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663767680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779054.696408:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.696706:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663767680 00000100:00100000:0.0:1790779054.696715:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663767680 00000100:00100000:0.0:1790779054.696760:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790779054.696770:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663767680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779054.696799:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790779054.696850:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663767680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.696857:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790779054.696971:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663767680:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790779055.017766:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779056.040054:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779056.744079:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779056.744110:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663767808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779056.744172:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779056.744333:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663767808 00000100:00100000:0.0:1790779056.744341:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663767808 00000100:00100000:0.0:1790779056.744394:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790779056.744403:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663767808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779056.744431:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790779056.744489:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663767808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779056.744495:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790779056.744742:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663767808:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790779057.066122:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779057.337497:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779057.337545:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779057.337563:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642707328 00000100:00100000:0.0:1790779057.337574:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642707328 00000100:00100000:1.0:1790779057.337579:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779057.337623:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 373 00000100:00100000:2.0:1790779057.337668:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642707584 00000100:00100000:2.0:1790779057.337672:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642707584 00000100:00100000:2.0:1790779057.337709:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642707456 00000100:00100000:2.0:1790779057.337712:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642707456 00000100:00100000:2.0:1790779057.337730:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:2.0:1790779057.337737:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642707584:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779057.337804:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642707584:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 68us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779057.337811:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:2.0:1790779057.337827:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:2.0:1790779057.337833:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642707456:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779057.337856:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642707456:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779057.337862:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00080000:2.0:1790779057.338013:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779057.338017:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790779057.338134:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642707328:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779057.338180:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642707328:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 548us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779057.341493:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 373 00000100:00100000:1.0:1790779057.345944:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779057.346200:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642707712 00000100:00100000:0.0:1790779057.346210:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642707712 00000100:00100000:0.0:1790779057.346342:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:0.0:1790779057.346353:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2397:x1877767642707712:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:0.0:1790779057.346394:0:8438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cd77 00000100:00080000:0.0:1790779057.346411:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9b773f4f9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790779057.346457:0:8438:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1790779057.346596:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+2:2397:x1877767642707712:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 245us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779057.346604:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00010000:00010000:1.0:1790779057.346761:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790779057.349924:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779057.360528:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779057.360568:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779057.360651:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642707840 00000100:00100000:1.0:1790779057.360661:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642707840 00000100:00100000:1.0:1790779057.360720:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642707968 00000100:00100000:1.0:1790779057.360723:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642707968 00000100:00100000:1.0:1790779057.360742:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:1.0:1790779057.360750:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642707840:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779057.360816:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642707840:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 66us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779057.360823:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:1.0:1790779057.360838:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00100000:1.0:1790779057.360843:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642707968:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779057.360862:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642707968:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 19us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779057.360868:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00080000:2.0:1790779057.361039:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779057.361043:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790779058.096035:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779058.280208:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779058.280248:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663767936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779058.280314:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779058.280476:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663767936 00000100:00100000:0.0:1790779058.280484:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663767936 00000100:00100000:0.0:1790779058.280534:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790779058.280543:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663767936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779058.280569:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779058.280614:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663767936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779058.280621:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790779058.280946:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663767936:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790779058.281256:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779058.281336:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779058.281347:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663768064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779058.281504:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779058.281615:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663768064 00000100:00100000:2.0:1790779058.281620:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663768064 00000100:00100000:2.0:1790779058.281785:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790779058.281793:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663768064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790779058.281809:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779058.281862:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663768064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779058.281869:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790779058.282547:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663768064:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790779058.282967:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790779059.112226:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779059.304057:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779059.304080:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663768192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779059.304150:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779059.304222:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663768192 00000100:00100000:0.0:1790779059.304229:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663768192 00000100:00100000:0.0:1790779059.304276:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790779059.304298:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663768192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779059.304327:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779059.304397:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663768192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779059.304406:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790779059.304435:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663768576:0@lo:400:kworker.0 00000100:00100000:0.0:1790779059.304469:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790779059.304479:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779059.304492:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663769088:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.304505:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663768448:0@lo:400:kworker.0 00000100:00100000:2.0:1790779059.304507:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663768576 00000100:00100000:2.0:1790779059.304513:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663768576 00000100:00100000:0.0:1790779059.304522:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779059.304552:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790779059.304555:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790779059.304562:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76039b8a80 x1877767663768192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779059.304563:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663768576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.304582:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663768960:0@lo:400:kworker.0 00000100:00100000:0.0:1790779059.304589:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663768192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779059.304611:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663769600:0@lo:400:kworker.0 00000100:00100000:2.0:1790779059.304624:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663768576:12345-0@lo:400:kworker.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779059.304625:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779059.304636:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790779059.304711:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663769088 00000100:00100000:3.0:1790779059.304715:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663768704:0@lo:400:kworker.0 00000100:00100000:0.0:1790779059.304717:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663769088 00000100:00100000:0.0:1790779059.304753:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663768448 00000100:00100000:0.0:1790779059.304757:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663768448 00000100:00100000:2.0:1790779059.304767:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663768960 00000100:00100000:2.0:1790779059.304773:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663768960 00000100:00100000:0.0:1790779059.304780:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790779059.304789:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663769088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779059.304801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1790779059.304820:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663768448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779059.317486:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790779059.317509:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779059.317510:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663768960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.317522:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663769472:0@lo:400:kworker.0 00000100:00100000:3.0:1790779059.317538:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663769216:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.317568:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779059.317581:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779059.317593:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663768960:12345-0@lo:400:kworker.0 Request processed in 95us (12970us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779059.317602:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790779059.317616:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663769728:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.317622:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663768960:0@lo:400:kworker.0 00000100:00100000:0.0:1790779059.317641:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663768704 00000100:00100000:1.0:1790779059.317643:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790779059.317647:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779059.317650:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663768704 00000100:00100000:1.0:1790779059.317665:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663768320:0@lo:400:kworker.0 00000100:00100000:0.0:1790779059.317684:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663769472 00000100:00100000:0.0:1790779059.317688:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663769472 00000100:00100000:1.0:1790779059.317709:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779059.317710:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1790779059.317721:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663768704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779059.317723:0:6524:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1790779059.317737:0:6524:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:1.0:1790779059.317747:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663768832:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.317780:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779059.317787:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663768704:12345-0@lo:400:kworker.0 Request processed in 67us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779059.317796:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1790779059.317802:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663769344:0@lo:400:kworker.0 00000100:00100000:3.0:1790779059.317816:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1790779059.317828:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663769472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.317829:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779059.317865:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663769088:12345-0@lo:400:kworker.0 Request processed in 13077us (13343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779059.317872:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1790779059.317907:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663769472:12345-0@lo:400:kworker.0 Request processed in 83us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779059.318014:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663768832 00000100:00100000:0.0:1790779059.318018:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663768832 00000100:00100000:0.0:1790779059.318044:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790779059.318049:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663768832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779059.318080:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663768832:12345-0@lo:400:kworker.0 Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779059.318085:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790779059.318103:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779059.318129:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663768576:0@lo:400:kworker.0 00010000:00080000:0.0:1790779059.318140:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603966d80 x1877767663769088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779059.318150:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663769088:0@lo:400:kworker.0 00000100:00100000:0.0:1790779059.318168:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663769600 00000100:00100000:0.0:1790779059.318171:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663769600 00000100:00100000:2.0:1790779059.318665:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663768320 00000100:00100000:2.0:1790779059.318672:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663768320 00000100:00100000:2.0:1790779059.318702:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1790779059.318716:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663768320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779059.318755:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663768320:12345-0@lo:400:kworker.0 Request processed in 40us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779059.318761:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00080000:2.0:1790779059.318816:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779059.318821:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779059.318857:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663768448:12345-0@lo:400:kworker.0 Request processed in 14038us (14306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779059.319100:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663769216 00000100:00100000:1.0:1790779059.319105:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663769216 00000100:00100000:1.0:1790779059.319136:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663769728 00000100:00100000:1.0:1790779059.319139:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663769728 00000100:00100000:1.0:1790779059.319157:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663769344 00000100:00100000:1.0:1790779059.319160:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663769344 00000100:00100000:1.0:1790779059.319171:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790779059.319178:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663769216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.319214:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663769216:12345-0@lo:400:kworker.0 Request processed in 36us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779059.319220:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790779059.319233:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790779059.319239:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663769728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.319266:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663769728:12345-0@lo:400:kworker.0 Request processed in 27us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779059.319271:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790779059.319282:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790779059.319288:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663769344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.319320:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663769344:12345-0@lo:400:kworker.0 Request processed in 32us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779059.319326:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790779059.319602:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663768704:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.319614:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663769216:0@lo:400:kworker.0 00010000:00080000:1.0:1790779059.319625:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c52300 x1877767663769728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779059.319635:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663769728:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.319718:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663769856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779059.319747:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779059.319784:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663768320:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.319795:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663768832:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.319804:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663769344:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.319812:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663768448:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.319820:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663769472:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.319851:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663769856 00000100:00100000:1.0:1790779059.319854:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663769856 00000100:00100000:1.0:1790779059.319904:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790779059.319911:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663769856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790779059.319925:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779059.319958:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663769856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779059.319978:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1790779059.320001:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4f6a00 x1877767663769856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779059.320026:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663769856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779059.323006:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:3.0:1790779059.323128:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779059.323220:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1790779059.323252:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1790779059.323268:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663769600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779059.323487:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663769600:12345-0@lo:400:kworker.0 Request processed in 227us (5382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779059.323494:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:0.0:1790779059.323969:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c50700 x1877767663769600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779059.323986:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663769600:0@lo:400:kworker.0 00000100:00100000:1.0:1790779059.816254:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663769984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779059.816321:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779059.816451:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663769984 00000100:00100000:0.0:1790779059.816471:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663769984 00000100:00100000:0.0:1790779059.816522:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790779059.816530:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663769984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779059.816562:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790779059.816607:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663769984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779059.816614:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790779059.816701:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663769984:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790779060.136425:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779061.160224:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779061.874333:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663770112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779061.874416:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779061.874529:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663770112 00000100:00100000:3.0:1790779061.874537:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663770112 00000100:00100000:3.0:1790779061.874595:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790779061.874605:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663770112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790779061.874637:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790779061.874691:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663770112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779061.874698:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790779061.874739:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663770112:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790779062.184088:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779062.485686:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779062.485725:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779062.485754:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779062.485778:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779062.485807:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779062.485831:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642708224 00000100:00100000:3.0:1790779062.485840:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642708224 00000100:00100000:2.0:1790779062.486067:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642708480 00000100:00100000:2.0:1790779062.486071:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642708480 00000100:00100000:2.0:1790779062.486096:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642708352 00000100:00100000:2.0:1790779062.486099:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642708352 00000100:00100000:2.0:1790779062.486109:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642708608 00000100:00100000:2.0:1790779062.486111:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642708608 00000100:00100000:2.0:1790779062.486124:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:2.0:1790779062.486132:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642708224:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779062.486209:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642708224:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 77us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779062.486217:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:2.0:1790779062.486234:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00100000:2.0:1790779062.486261:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642708480:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779062.486291:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642708480:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 33us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779062.486298:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00100000:2.0:1790779062.486520:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:1.0:1790779062.486530:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 254 00000100:00100000:2.0:1790779062.486531:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642708352:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779062.486548:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642708608:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779062.486576:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642708352:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 48us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779062.486584:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:1.0:1790779062.486589:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642708608:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 45us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779062.486600:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 254 00000100:00080000:3.0:1790779062.486705:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779062.486710:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779062.486772:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642708096 00000100:00100000:0.0:1790779062.486778:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642708096 00000100:00100000:0.0:1790779062.486823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 375 00000100:00100000:0.0:1790779062.486832:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642708096:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779062.486862:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642708096:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 33us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779062.486869:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 375 00000001:00100000:0.0:1790779062.890665:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000020:00000080:0.0:1790779062.890675:0:8432:0:(genops.c:885:class_export_put()) final put ffff9b773f4f8000/e5203316-d1cf-49fe-9b64-c701aab9b690 00000020:00000080:3.0:1790779062.891067:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773f4f8000/e5203316-d1cf-49fe-9b64-c701aab9b690 for lustre-OST0000 00000020:00000080:3.0:1790779062.891123:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773f4f9000 for lustre-OST0000 00000040:00080000:1.0:1790779062.953386:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1790779062.954050:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779063.208974:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779063.402110:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663770240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779063.402182:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779063.403268:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663770240 00000100:00100000:2.0:1790779063.403278:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663770240 00000100:00100000:2.0:1790779063.403348:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790779063.403358:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663770240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790779063.403389:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779063.403450:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663770240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779063.403458:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790779063.403756:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663770240:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790779063.408038:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779063.408451:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790779063.408472:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663770368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779063.408557:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779063.408634:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663770368 00000100:00100000:0.0:1790779063.408642:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663770368 00000100:00100000:0.0:1790779063.408712:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790779063.408720:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663770368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779063.408742:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779063.408783:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663770368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779063.408805:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1790779063.408851:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779063.408928:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663770368:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790779064.234126:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779064.427046:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663770496:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427115:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427162:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663771008:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427189:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427209:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663771520:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427229:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427242:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663772032:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427259:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427282:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790779064.427298:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663770880:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427334:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427353:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663771392:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427372:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427388:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663771904:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427407:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427435:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663770624:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427458:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427476:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663771136:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427496:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427512:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663771648:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427532:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427548:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663772160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779064.427578:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427596:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790779064.427601:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663770752:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427623:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427638:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663771264:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427657:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427672:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663771776:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427689:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.427718:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663770496 00000100:00100000:0.0:1790779064.427726:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663770496 00000100:00100000:0.0:1790779064.427770:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1790779064.427779:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663770496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427825:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663770496:12345-0@lo:400:kworker.0 Request processed in 48us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.427832:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1790779064.427865:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663771008 00000100:00100000:0.0:1790779064.427869:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663771008 00000100:00100000:0.0:1790779064.427906:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663770752 00000100:00100000:0.0:1790779064.427909:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663770752 00000100:00100000:0.0:1790779064.427922:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790779064.427928:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663771008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.427961:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663771008:12345-0@lo:400:kworker.0 Request processed in 34us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.427967:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790779064.427978:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790779064.427983:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663770752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428020:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663770752:12345-0@lo:400:kworker.0 Request processed in 38us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428026:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790779064.428043:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663771520 00000100:00100000:0.0:1790779064.428046:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663771520 00000100:00100000:0.0:1790779064.428062:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663772032 00000100:00100000:0.0:1790779064.428065:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663772032 00000100:00100000:0.0:1790779064.428084:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663771392 00000100:00100000:0.0:1790779064.428087:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663771392 00000100:00100000:0.0:1790779064.428096:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663771904 00000100:00100000:0.0:1790779064.428099:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663771904 00000100:00100000:0.0:1790779064.428112:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790779064.428118:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663771520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428148:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663771520:12345-0@lo:400:kworker.0 Request processed in 30us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428154:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790779064.428166:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790779064.428172:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663772032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428197:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663772032:12345-0@lo:400:kworker.0 Request processed in 26us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428203:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790779064.428214:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790779064.428219:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663771392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428244:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663771392:12345-0@lo:400:kworker.0 Request processed in 25us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428249:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790779064.428260:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790779064.428271:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663771904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428302:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663771904:12345-0@lo:400:kworker.0 Request processed in 31us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428307:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790779064.428338:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663770880 00000100:00100000:0.0:1790779064.428342:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663770880 00000100:00100000:0.0:1790779064.428360:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663770624 00000100:00100000:0.0:1790779064.428363:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663770624 00000100:00100000:0.0:1790779064.428371:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663771136 00000100:00100000:0.0:1790779064.428373:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663771136 00000100:00100000:0.0:1790779064.428382:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663771648 00000100:00100000:0.0:1790779064.428384:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663771648 00000100:00100000:0.0:1790779064.428394:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663771264 00000100:00100000:0.0:1790779064.428396:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663771264 00000100:00100000:0.0:1790779064.428406:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663771776 00000100:00100000:0.0:1790779064.428409:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663771776 00000100:00100000:0.0:1790779064.428421:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790779064.428428:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663770880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428456:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663770880:12345-0@lo:400:kworker.0 Request processed in 30us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428462:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790779064.428473:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790779064.428478:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663770624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428503:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663770624:12345-0@lo:400:kworker.0 Request processed in 25us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428508:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790779064.428518:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790779064.428524:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663771136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428563:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663771136:12345-0@lo:400:kworker.0 Request processed in 39us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428569:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790779064.428581:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790779064.428586:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663771648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428624:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663771648:12345-0@lo:400:kworker.0 Request processed in 38us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428630:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790779064.428642:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790779064.428648:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663771264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428674:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663771264:12345-0@lo:400:kworker.0 Request processed in 27us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428680:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790779064.428690:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790779064.428696:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663771776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428722:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663771776:12345-0@lo:400:kworker.0 Request processed in 27us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428728:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790779064.428768:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663772160 00000100:00100000:0.0:1790779064.428772:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663772160 00000100:00100000:0.0:1790779064.428794:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790779064.428800:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663772160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779064.428822:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779064.428849:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663772160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.428863:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790779064.428936:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663770880:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428948:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663771392:0@lo:400:kworker.0 00010000:00080000:0.0:1790779064.428961:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760384ca80 x1877767663771904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779064.428972:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663771904:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428981:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663770496:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.428990:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663771008:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.429001:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663771520:0@lo:400:kworker.0 00010000:00080000:0.0:1790779064.429009:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760384ea00 x1877767663772032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779064.429017:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663772032:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.429063:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663770752:0@lo:400:kworker.0 00010000:00080000:0.0:1790779064.429073:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a40380 x1877767663771264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779064.429082:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663771264:0@lo:400:kworker.0 00010000:00080000:0.0:1790779064.429091:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760384d180 x1877767663771776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779064.429098:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663771776:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.429108:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663770624:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.429126:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663771136:0@lo:400:kworker.0 00000100:00100000:0.0:1790779064.429135:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663771648:0@lo:400:kworker.0 00010000:00080000:0.0:1790779064.429143:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760384df80 x1877767663772160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779064.429155:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663772160:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790779064.429184:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790779064.429188:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779064.429191:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779064.433780:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663772288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779064.433841:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779064.433963:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663772288 00000100:00100000:0.0:1790779064.433970:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663772288 00000100:00100000:0.0:1790779064.434066:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790779064.434074:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663772288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779064.434094:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779064.434130:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663772288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779064.434137:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1790779064.434179:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603b6df80 x1877767663772288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779064.434196:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663772288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779064.938515:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779064.938538:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663772416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779064.938606:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779064.938675:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663772416 00000100:00100000:1.0:1790779064.938684:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663772416 00000100:00100000:1.0:1790779064.938725:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790779064.938733:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663772416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790779064.938764:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790779064.938808:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663772416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779064.938827:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790779064.938874:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663772416:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790779065.265361:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779066.280152:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779066.997051:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663772544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779066.997130:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779066.997326:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663772544 00000100:00100000:1.0:1790779066.997334:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663772544 00000100:00100000:1.0:1790779066.997381:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790779066.997391:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663772544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779066.997433:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790779066.997489:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663772544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779066.997496:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790779066.997654:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663772544:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790779067.305321:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779067.577275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779067.577327:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779067.577358:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779067.577391:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779067.577424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779067.577451:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642708992 00000100:00100000:0.0:1790779067.577460:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642708992 00000100:00100000:0.0:1790779067.577511:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642709248 00000100:00100000:0.0:1790779067.577514:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642709248 00000100:00100000:0.0:1790779067.577533:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642708864 00000100:00100000:0.0:1790779067.577536:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642708864 00000100:00100000:0.0:1790779067.577550:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642709120 00000100:00100000:0.0:1790779067.577552:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642709120 00000100:00100000:0.0:1790779067.577568:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 261 00000100:00100000:0.0:1790779067.577587:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642708992:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779067.577657:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642708992:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 81us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779067.577664:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 261 00000100:00100000:0.0:1790779067.577681:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 262 00000100:00100000:0.0:1790779067.577687:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642709248:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779067.577711:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642709248:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 24us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779067.577717:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 262 00000100:00100000:0.0:1790779067.577729:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 263 00000100:00100000:0.0:1790779067.577735:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642708864:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779067.577761:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642708864:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779067.577767:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 263 00000100:00100000:0.0:1790779067.577779:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 264 00000100:00100000:0.0:1790779067.577785:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642709120:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779067.579926:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642709120:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 2130us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779067.579939:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 264 00000100:00080000:0.0:1790779067.579983:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779067.579988:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779067.580105:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642708736 00000100:00100000:1.0:1790779067.580113:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642708736 00000100:00100000:1.0:1790779067.580149:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 377 00000100:00100000:1.0:1790779067.580158:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642708736:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779067.580207:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642708736:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 50us (2942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779067.580214:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 377 00000001:02000400:3.0:1790779067.719664:0:14064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:37:45 (1790779065) 00010000:00010000:3.0:1790779068.328016:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779068.520168:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779068.520190:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663772672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779068.520257:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779068.520341:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663772672 00000100:00100000:1.0:1790779068.520349:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663772672 00000100:00100000:1.0:1790779068.520396:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790779068.520406:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663772672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779068.520435:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779068.520492:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663772672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779068.520499:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790779068.520557:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663772672:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790779068.520996:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779068.521044:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779068.521065:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663772800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779068.521098:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779068.521760:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663772800 00000100:00100000:0.0:1790779068.521767:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663772800 00000100:00100000:0.0:1790779068.521822:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790779068.521831:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663772800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779068.521847:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779068.521917:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663772800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779068.521924:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1790779068.521997:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779068.522030:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663772800:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790779069.352750:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779069.544331:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663773184:0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.544397:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779069.544449:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663773696:0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.544467:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779069.544484:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663774208:0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.544499:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779069.544531:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790779069.544536:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663773312:0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.544559:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779069.544572:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663773824:0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.544587:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779069.544597:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663774336:0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.544613:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779069.544648:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663773184 00000100:00100000:3.0:1790779069.544655:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663773184 00000100:00100000:3.0:1790779069.544691:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663773696 00000100:00100000:3.0:1790779069.544693:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663773696 00000100:00100000:3.0:1790779069.544710:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663774208 00000100:00100000:3.0:1790779069.544712:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663774208 00000100:00100000:3.0:1790779069.544723:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663773824 00000100:00100000:3.0:1790779069.544744:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663773824 00000100:00100000:3.0:1790779069.544757:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663774336 00000100:00100000:3.0:1790779069.544759:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663774336 00000100:00100000:3.0:1790779069.544771:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1790779069.544778:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663773184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.544823:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663773184:12345-0@lo:400:kworker.0 Request processed in 45us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779069.544829:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1790779069.544854:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790779069.544860:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663773696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.544912:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663773696:12345-0@lo:400:kworker.0 Request processed in 52us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779069.544918:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790779069.544928:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790779069.544933:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663774208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.544965:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663774208:12345-0@lo:400:kworker.0 Request processed in 32us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779069.544970:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790779069.544979:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790779069.544984:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663773824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.545006:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663773824:12345-0@lo:400:kworker.0 Request processed in 22us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779069.545011:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790779069.545019:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1790779069.545024:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663774336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.545043:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663774336:12345-0@lo:400:kworker.0 Request processed in 20us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779069.545053:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1790779069.545067:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779069.545070:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790779069.545094:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ec380 x1877767663773824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779069.545107:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663773824:0@lo:400:kworker.0 00010000:00080000:3.0:1790779069.545116:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603744a80 x1877767663774336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779069.545123:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663774336:0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.545131:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663773184:0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.545138:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663773696:0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.545145:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663774208:0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.545643:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663772928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779069.545682:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779069.545719:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663773440:0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.545747:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779069.545763:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663773952:0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.545782:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779069.545794:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663774464:0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.545808:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779069.545822:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1790779069.545828:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663773056:0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.545859:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779069.545875:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663773568:0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.545921:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779069.545934:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663774080:0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.545949:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779069.545974:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663774592:0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.545991:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779069.546012:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663773312 00000100:00100000:1.0:1790779069.546017:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663773312 00000100:00100000:1.0:1790779069.546038:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663773568 00000100:00100000:1.0:1790779069.546040:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663773568 00000100:00100000:1.0:1790779069.546059:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790779069.546065:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663773312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.546100:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663773312:12345-0@lo:400:kworker.0 Request processed in 35us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779069.546106:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790779069.546118:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790779069.546123:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663773568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.546147:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663773568:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779069.546152:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790779069.546177:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663773568:0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.546191:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663773440 00000100:00100000:1.0:1790779069.546193:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663773440 00000100:00100000:1.0:1790779069.546207:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1790779069.546212:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663773440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.546238:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663773440:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779069.546244:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1790779069.546262:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663773440:0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.546647:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663772928 00000100:00100000:3.0:1790779069.546652:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663772928 00000100:00100000:3.0:1790779069.546691:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790779069.546698:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663772928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779069.546719:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779069.546809:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663772928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779069.546816:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790779069.546962:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663773952 00000100:00100000:0.0:1790779069.546967:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663773952 00000100:00100000:0.0:1790779069.546987:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663774464 00000100:00100000:0.0:1790779069.546989:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663774464 00000100:00100000:0.0:1790779069.546997:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663774080 00000100:00100000:0.0:1790779069.547000:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663774080 00000100:00100000:0.0:1790779069.547009:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663774592 00000100:00100000:0.0:1790779069.547011:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663774592 00000100:00100000:0.0:1790779069.547025:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790779069.547031:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663773952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779069.547235:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779069.547246:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663774720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779069.547307:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663773312:0@lo:400:kworker.0 00000100:00100000:3.0:1790779069.547363:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663773056 00000100:00100000:3.0:1790779069.547367:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663773056 00000100:00100000:3.0:1790779069.547401:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1790779069.547407:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663773056:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790779069.547462:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779069.550083:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663773952:12345-0@lo:400:kworker.0 Request processed in 3044us (4291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779069.550097:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790779069.550130:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790779069.550156:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663774464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779069.550207:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663774464:12345-0@lo:400:kworker.0 Request processed in 57us (4397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779069.550214:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790779069.550227:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790779069.550234:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663774080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779069.550296:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663774080:12345-0@lo:400:kworker.0 Request processed in 63us (4345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779069.550303:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790779069.550315:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790779069.550322:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663774592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779069.550351:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663774592:12345-0@lo:400:kworker.0 Request processed in 30us (4358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779069.550356:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790779069.552690:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779069.553230:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663774720 00000100:00100000:0.0:1790779069.553239:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663774720 00000100:00100000:0.0:1790779069.553301:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790779069.553310:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663774720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779069.553334:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779069.553385:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663774720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779069.553392:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1790779069.553430:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c52a00 x1877767663774720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779069.553449:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663774720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779069.561462:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663773056:12345-0@lo:400:kworker.0 Request processed in 14046us (15592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779069.561477:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00010000:00080000:1.0:1790779069.566657:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7ab800 x1877767663772928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779069.566688:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663772928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779069.566709:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663773952:0@lo:400:kworker.0 00010000:00080000:1.0:1790779069.566751:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603747800 x1877767663774464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779069.566760:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663774464:0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.566793:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663773056:0@lo:400:kworker.0 00000100:00100000:1.0:1790779069.566804:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663774080:0@lo:400:kworker.0 00010000:00080000:1.0:1790779069.566815:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a3e680 x1877767663774592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779069.566822:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663774592:0@lo:400:kworker.0 00000100:00100000:0.0:1790779069.851010:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779069.851155:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642709376 00000100:00100000:1.0:1790779069.851164:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642709376 00000100:00100000:1.0:1790779069.851236:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:1.0:1790779069.851245:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:11070:x1877767642709376:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779069.851290:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779069.851313:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936ce57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42578e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779069.851377:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936ce5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779069.851391:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936ce5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779069.851405:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936ce5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779069.851451:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790779069.851466:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779069.851502:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936ce5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779069.851525:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936ce57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42578e expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779069.851542:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936ce5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42578e expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779069.851551:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b771d81a500) 00010000:00010000:1.0:1790779069.851554:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790779069.851557:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055ce800, rc 0) 00000100:00100000:1.0:1790779069.851619:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:11070:x1877767642709376:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 374us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779069.851626:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00080000:3.0:1790779069.852007:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779069.868774:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779069.870468:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642709504 00000100:00100000:0.0:1790779069.870481:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642709504 00000100:00100000:0.0:1790779069.870552:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:0.0:1790779069.870563:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+6:11071:x1877767642709504:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779069.870582:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779069.870600:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936ce65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425795 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870661:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870676:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870688:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870703:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870710:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870716:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870773:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769000/0xb1aa4014e936ce7a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870781:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769000/0xb1aa4014e936ce7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870800:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769000/0xb1aa4014e936ce7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779069.870836:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790779069.870839:0:13821:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779069.870858:0:13821:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769000/0xb1aa4014e936ce7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870868:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870874:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870910:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870915:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779069.870919:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870927:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870938:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b771d81a500) 00010000:00010000:0.0:1790779069.870942:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779069.870946:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870951:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870973:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870979:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870985:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870989:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779069.870992:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.870997:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.871005:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b7603615b00) 00010000:00010000:0.0:1790779069.871007:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779069.871009:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.871015:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.871042:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936ce65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425795 expref: 8 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.871053:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769000/0xb1aa4014e936ce7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425795 expref: 7 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.871369:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b7603615200) 00010000:00010000:0.0:1790779069.871371:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790779069.871373:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769000, rc 0) 00000100:00100000:0.0:1790779069.871467:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+7:11071:x1877767642709504:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 906us (2703us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779069.871474:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:2.0:1790779069.880049:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779069.880145:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642709632 00000100:00100000:3.0:1790779069.880156:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642709632 00000100:00100000:3.0:1790779069.880231:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:3.0:1790779069.880242:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:11071:x1877767642709632:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790779069.880365:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:11071:x1877767642709632:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 Request processed in 124us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779069.880374:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1790779069.909740:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779069.911239:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642709888 00000100:00100000:0.0:1790779069.911265:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642709888 00000100:00100000:0.0:1790779069.911358:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:0.0:1790779069.911369:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:11071:x1877767642709888:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779069.911395:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779069.911416:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936ce81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42579c expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911485:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce88 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911500:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911510:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911611:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce8f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911620:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911641:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911760:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ce96 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911769:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ce96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911776:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ce96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779069.911786:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790779069.911866:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911874:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce88 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911987:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.911993:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779069.911997:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.912005:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce88 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.912016:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b7603615200) 00010000:00010000:0.0:1790779069.912019:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779069.912030:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce88 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.912036:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ce88 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.912050:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.912056:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce8f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.912060:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.912065:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779069.912067:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.912072:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce8f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.912079:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b7603615b00) 00010000:00010000:0.0:1790779069.912082:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779069.912084:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce8f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779069.912089:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ce8f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779069.920503:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936ce81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42579c expref: 10 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779069.920531:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ce96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42579c expref: 9 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779069.920541:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:1.0:1790779069.920544:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779069.920548:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769200, rc 0) 00000100:00100000:1.0:1790779069.920666:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+9:11071:x1877767642709888:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 9297us (10937us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790779069.920675:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:2.0:1790779069.945983:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779069.946084:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642710016 00000100:00100000:1.0:1790779069.946095:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642710016 00000100:00100000:1.0:1790779069.946144:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:1.0:1790779069.946153:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+9:11071:x1877767642710016:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790779069.946291:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+9:11071:x1877767642710016:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 139us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779069.946298:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:2.0:1790779069.952601:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779069.952678:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642710144 00000100:00100000:0.0:1790779069.952686:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642710144 00000100:00100000:0.0:1790779069.952758:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:0.0:1790779069.952777:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:11071:x1877767642710144:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1790779069.953020:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1790779069.953822:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1009us 00000100:00100000:0.0:1790779069.997294:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:11071:x1877767642710144:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 44500us (44683us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779069.997307:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:0.0:1790779070.056057:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663774848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779070.056120:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779070.056284:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663774848 00000100:00100000:1.0:1790779070.056291:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663774848 00000100:00100000:1.0:1790779070.056337:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790779070.056345:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663774848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790779070.056381:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790779070.056425:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663774848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779070.056431:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790779070.056682:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663774848:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1790779070.142550:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1790779070.145848:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779070.377468:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779071.401356:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779072.108390:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663774976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779072.108455:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779072.109149:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663774976 00000100:00100000:1.0:1790779072.109157:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663774976 00000100:00100000:1.0:1790779072.109222:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790779072.109232:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663774976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779072.109275:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790779072.109326:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663774976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779072.109334:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790779072.109474:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663774976:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1790779072.178872:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1790779072.246833:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790779072.428857:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779072.702360:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779072.702400:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779072.702434:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779072.702453:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779072.702473:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779072.702524:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642710400 00000100:00100000:1.0:1790779072.702542:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642710400 00000100:00100000:0.0:1790779072.702553:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642710656 00000100:00100000:0.0:1790779072.702557:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642710656 00000100:00100000:1.0:1790779072.702642:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642710528 00000100:00100000:1.0:1790779072.702659:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642710528 00000100:00100000:3.0:1790779072.703624:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642710784 00000100:00100000:3.0:1790779072.703631:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642710784 00000100:00100000:0.0:1790779072.708843:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 271 00000100:00100000:0.0:1790779072.708859:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2399:x1877767642710400:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779072.709778:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2399:x1877767642710400:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 919us (7422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779072.709788:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 271 00000100:00100000:0.0:1790779072.709815:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 272 00000100:00100000:0.0:1790779072.709825:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642710656:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779072.709857:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642710656:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 35us (7457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779072.709863:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 272 00000100:00080000:2.0:1790779072.710071:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779072.710078:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779072.710471:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 273 00000100:00100000:1.0:1790779072.710482:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642710528:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779072.710517:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642710528:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 38us (8063us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779072.710523:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 273 00000100:00100000:0.0:1790779072.710705:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642710272 00000100:00100000:0.0:1790779072.710714:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642710272 00000100:00100000:3.0:1790779072.710729:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 274 00000100:00100000:3.0:1790779072.710737:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642710784:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779072.710741:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 379 00000100:00100000:0.0:1790779072.710747:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642710272:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779072.710765:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642710784:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (8292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779072.710767:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642710272:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (8333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779072.710771:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 274 00000100:00100000:0.0:1790779072.710786:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 379 00000100:00100000:3.0:1790779072.796366:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779072.796402:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642710912 00000100:00100000:3.0:1790779072.796411:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642710912 00000100:00100000:3.0:1790779072.796461:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:3.0:1790779072.796471:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+9:11113:x1877767642710912:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779072.796500:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779072.796520:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7200/0xb1aa4014e936cea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257a3 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796584:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7e00/0xb1aa4014e936ceab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796598:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7e00/0xb1aa4014e936ceab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796609:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7e00/0xb1aa4014e936ceab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796623:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936ceb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796629:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936ceb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796635:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936ceb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796673:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7e00/0xb1aa4014e936ceab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796680:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7e00/0xb1aa4014e936ceab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796686:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7e00/0xb1aa4014e936ceab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796691:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e7e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779072.796702:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7e00/0xb1aa4014e936ceab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796709:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7e00/0xb1aa4014e936ceab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796720:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b771d81a500) 00010000:00010000:3.0:1790779072.796723:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779072.796726:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7e00/0xb1aa4014e936ceab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796732:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7e00/0xb1aa4014e936ceab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796743:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936ceb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796749:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936ceb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796754:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936ceb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796759:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e6a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779072.796762:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936ceb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796767:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936ceb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796773:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b7703991600) 00010000:00010000:3.0:1790779072.796775:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779072.796783:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936ceb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796789:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e6a00/0xb1aa4014e936ceb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796821:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7200/0xb1aa4014e936cea4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257a3 expref: 10 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796831:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b771d81a500) 00010000:00010000:3.0:1790779072.796833:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779072.796837:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77089e7200/0xb1aa4014e936cea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257a3 expref: 10 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.796847:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77089e7200, rc 0) 00000100:00100000:3.0:1790779072.796942:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+9:11113:x1877767642710912:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 461us (571us total) trans 0 rc 301/301 00000100:00100000:3.0:1790779072.796949:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:0.0:1790779072.812874:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779072.818024:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642711168 00000100:00100000:3.0:1790779072.818040:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642711168 00000100:00100000:3.0:1790779072.818110:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:3.0:1790779072.818120:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+9:11113:x1877767642711168:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:3.0:1790779072.818175:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779072.818202:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936ce5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42578e expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.818233:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b771d81a500) 00010000:00010000:3.0:1790779072.818246:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779072.818330:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ceb9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.818344:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ceb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.818354:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ceb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.818366:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.818373:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.818379:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.818929:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.818939:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.818947:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779072.818962:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dea79814 reply state 00000000b0f49fc5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.818973:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.818979:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779072.818989:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790779072.818992:0:6524:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790779072.818998:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1790779072.819007:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ceb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.819014:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ceb9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.819021:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ceb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.819026:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779072.819030:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ceb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.819038:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ceb9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.819047:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7703991b00) 00010000:00010000:3.0:1790779072.819050:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779072.819053:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ceb9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.819059:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ceb9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779072.819076:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dea79814 reply state 00000000b0f49fc5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.819085:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779072.819102:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b7703991e00) 00010000:00010000:3.0:1790779072.819104:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790779072.819107:0:6524:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1790779072.819208:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+10:11113:x1877767642711168:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 1088us (6339us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790779072.819217:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:2.0:1790779073.055854:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779073.055987:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642711296 00000100:00100000:0.0:1790779073.055998:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642711296 00000100:00100000:0.0:1790779073.056063:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:0.0:1790779073.056074:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+10:11121:x1877767642711296:12345-192.168.203.3@tcp:101:lctl.0 00010000:00010000:0.0:1790779073.056099:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779073.056132:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cece lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257aa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.056211:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936ced5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.056235:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936ced5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.056250:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936ced5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779073.056306:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790779073.056310:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779073.056350:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936ced5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.056375:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936cece lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257aa expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.056394:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936ced5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257aa expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.056424:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603618200) 00010000:00010000:0.0:1790779073.056427:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790779073.056431:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769600, rc 0) 00000100:00100000:0.0:1790779073.056500:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+11:11121:x1877767642711296:12345-192.168.203.3@tcp:101:lctl.0 Request processed in 427us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779073.056507:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:2.0:1790779073.185990:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779073.186154:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642711424 00000100:00100000:3.0:1790779073.186165:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642711424 00000100:00100000:3.0:1790779073.186237:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:3.0:1790779073.186246:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+11:11127:x1877767642711424:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779073.186276:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779073.186296:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936cedc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257b1 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186368:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cee3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186383:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cee3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186395:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cee3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186405:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186412:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186437:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186512:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663e00/0xb1aa4014e936cef1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186519:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663e00/0xb1aa4014e936cef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186526:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663e00/0xb1aa4014e936cef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779073.186560:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790779073.186564:0:13003:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779073.186604:0:13003:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663e00/0xb1aa4014e936cef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186616:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cee3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186623:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cee3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186644:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cee3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186650:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779073.186654:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cee3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186662:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cee3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186682:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603618200) 00010000:00010000:3.0:1790779073.186684:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779073.186689:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cee3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186695:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cee3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186708:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186715:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186721:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186726:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779073.186728:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186735:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186742:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b7703991e00) 00010000:00010000:3.0:1790779073.186744:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779073.186747:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186752:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186791:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936cedc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b1 expref: 13 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186805:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663e00/0xb1aa4014e936cef1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b1 expref: 12 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.186812:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779073.186814:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790779073.186817:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663e00, rc 0) 00000100:00100000:3.0:1790779073.186927:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+12:11127:x1877767642711424:12345-192.168.203.3@tcp:101:bash.0 Request processed in 633us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779073.186935:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:2.0:1790779073.210986:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779073.211127:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642711680 00000100:00100000:3.0:1790779073.211136:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642711680 00000100:00100000:3.0:1790779073.211196:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:3.0:1790779073.211207:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+12:11127:x1877767642711680:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779073.211237:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779073.211265:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936cef8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257b8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.211380:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.211395:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.211406:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.211457:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.211466:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.211474:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790779073.211793:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1790779073.211969:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936cf0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.211979:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936cf0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.211987:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936cf0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.212019:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.212027:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.212034:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.212040:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779073.212045:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.212065:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.212077:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779073.212080:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779073.212084:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.212091:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936ceff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779073.212104:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004959a3ff reply state 00000000f2f01796 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.212114:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.212119:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7703991b00) 00010000:00010000:3.0:1790779073.212122:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790779073.212124:0:6524:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790779073.212152:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936cef8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b8 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.212166:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936cf0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b8 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.212174:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7703991600) 00010000:00010000:3.0:1790779073.212176:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779073.212178:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663a00, rc 0) 00000100:00100000:3.0:1790779073.212247:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+15:11127:x1877767642711680:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1041us (1270us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1790779073.212270:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:2.0:1790779073.223036:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779073.223152:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642711808 00000100:00100000:0.0:1790779073.223162:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642711808 00000100:00100000:0.0:1790779073.223212:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:0.0:1790779073.223220:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1877767642711808:12345-192.168.203.3@tcp:8:bash.0 00010000:00080000:0.0:1790779073.223263:0:8438:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:0.0:1790779073.223293:0:8438:0:(genops.c:1384:class_connect()) connect: client e5203316-d1cf-49fe-9b64-c701aab9b690, cookie 0xb1aa4014e936cf1b 00002000:00100000:0.0:1790779073.223314:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e5203316-d1cf-49fe-9b64-c701aab9b690/ffff9b773b6d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790779073.223331:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790779073.223402:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790779073.223432:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9b773b6d2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779073.223506:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2397:x1877767642711808:12345-192.168.203.3@tcp:8:bash.0 Request processed in 284us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779073.223514:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:2.0:1790779073.226235:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779073.226381:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642711936 00000100:00100000:0.0:1790779073.226391:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642711936 00000100:00100000:0.0:1790779073.226463:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:0.0:1790779073.226472:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:0:x1877767642711936:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1790779073.226490:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779073.226523:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a81c716/0xb1aa4014e936cf22 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257bf expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779073.226545:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779073.226562:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=391s v=(0 0) 00010000:00010000:0.0:1790779073.226566:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779073.226575:0:8439:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a81c716/0xb1aa4014e936cf22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257bf expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.226594:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a81c716/0xb1aa4014e936cf22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257bf expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.226604:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769800, rc 0) 00000100:00100000:0.0:1790779073.226654:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:0:x1877767642711936:12345-192.168.203.3@tcp:101:bash.0 Request processed in 184us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779073.226661:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00080000:2.0:1790779073.229355:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779073.241571:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779073.241693:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642712064 00000100:00100000:1.0:1790779073.241703:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642712064 00000100:00100000:1.0:1790779073.241760:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:1.0:1790779073.241770:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:11127:x1877767642712064:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1790779073.241788:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779073.241809:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257c6 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.241840:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a81c716/0xb1aa4014e936cf22 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257bf expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.241850:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779073.241855:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779073.241860:0:8438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.241927:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a81c716/0xb1aa4014e936cf22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257bf expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.241942:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a81c716/0xb1aa4014e936cf22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257bf expref: 8 pid: 8439 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779073.241973:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1877767663775104:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779073.242066:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81480 going to sleep for 11 seconds 00000100:00100000:1.0:1790779073.245696:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1877767663775104:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779073.245739:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.245760:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055ce400, rc 0) 00000100:00100000:1.0:1790779073.245834:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+8:11127:x1877767642712064:12345-192.168.203.3@tcp:101:bash.0 Request processed in 4065us (4272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779073.245843:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1790779073.248650:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779073.248861:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642712192 00000100:00100000:2.0:1790779073.248872:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642712192 00010000:00010000:2.0:1790779073.248937:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a81c716/0xb1aa4014e936cf22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257bf expref: 8 pid: 8439 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779073.248978:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:2.0:1790779073.248990:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642712192:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779073.249004:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779073.249024:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a81c716/0xb1aa4014e936cf22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257bf expref: 8 pid: 8439 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.249037:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a81c716/0xb1aa4014e936cf22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257bf expref: 8 pid: 8439 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.249062:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a81c716/0xb1aa4014e936cf22 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257bf expref: 8 pid: 8439 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.249079:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779073.249584:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779073.249593:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.249604:0:7465:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.249667:0:7465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779073.249683:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7465:1877767663775232:192.168.203.3@tcp:105: 00000100:00100000:2.0:1790779073.250348:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760345b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779073.261651:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779073.261734:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642712448 00000100:00100000:1.0:1790779073.261743:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642712448 00000100:00100000:1.0:1790779073.261794:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:1.0:1790779073.261803:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+15:11127:x1877767642712448:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:1.0:1790779073.262093:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+16:11127:x1877767642712448:12345-192.168.203.3@tcp:35:bash.0 Request processed in 291us (450us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790779073.262100:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:0.0:1790779073.263121:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7465:1877767663775232:192.168.203.3@tcp:105: 00010000:00010000:0.0:1790779073.263142:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779073.263232:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2401:x1877767642712192:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 14245us (14594us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779073.263241:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00010000:00010000:2.0:1790779073.449604:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779073.450563:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779073.450656:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642712704 00000100:00100000:0.0:1790779073.450667:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642712704 00000100:00100000:0.0:1790779073.450729:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1790779073.450738:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+16:11137:x1877767642712704:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1790779073.450762:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779073.450793:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936cf30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257cd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779073.450923:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1790779073.451027:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936cf30 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257cd expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.451041:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603618200) 00010000:00010000:0.0:1790779073.451043:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790779073.451048:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936cf30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257cd expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.451062:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769a00, rc 0) 00000100:00100000:0.0:1790779073.451151:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+17:11137:x1877767642712704:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 387us (567us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1790779073.451159:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:2.0:1790779073.464683:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779073.464773:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642712960 00000100:00100000:1.0:1790779073.464783:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642712960 00000100:00100000:1.0:1790779073.464841:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1790779073.464852:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+17:11137:x1877767642712960:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:1.0:1790779073.465101:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+18:11137:x1877767642712960:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 250us (427us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1790779073.465127:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1790779073.618569:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779073.618657:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642713088 00000100:00100000:3.0:1790779073.618667:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642713088 00000100:00100000:3.0:1790779073.618727:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:3.0:1790779073.618738:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+18:11143:x1877767642713088:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779073.618762:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779073.618783:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936cf3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257d4 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.618846:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936cf45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.618860:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936cf45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.618871:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936cf45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779073.618941:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790779073.618945:0:13003:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779073.618962:0:13003:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936cf45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.618989:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936cf3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257d4 expref: 20 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.619007:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936cf45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257d4 expref: 19 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.619033:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779073.619037:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779073.619040:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662000, rc 0) 00000100:00100000:3.0:1790779073.619112:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+19:11143:x1877767642713088:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 376us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779073.619127:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:3.0:1790779073.624702:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779073.624796:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642713344 00000100:00100000:1.0:1790779073.624807:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642713344 00000100:00100000:1.0:1790779073.624871:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:1.0:1790779073.624908:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+19:11143:x1877767642713344:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779073.624930:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779073.624951:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cf4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257db expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.625065:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936cf53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.625079:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936cf53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.625090:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936cf53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779073.625101:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790779073.625211:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cf4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257db expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.625228:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936cf53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257db expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.625237:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7703991600) 00010000:00010000:1.0:1790779073.625240:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779073.625244:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055ce800, rc 0) 00000100:00100000:1.0:1790779073.626160:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+21:11143:x1877767642713344:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1278us (1464us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1790779073.626169:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:0.0:1790779073.643367:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779073.643389:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663775360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779073.643458:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779073.643582:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663775360 00000100:00100000:1.0:1790779073.643590:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663775360 00000100:00100000:1.0:1790779073.643648:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790779073.643659:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663775360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779073.643686:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779073.643731:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663775360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779073.643738:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1790779073.643803:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779073.643835:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663775360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779073.644267:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779073.644277:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663775488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779073.644308:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779073.644384:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663775488 00000100:00100000:0.0:1790779073.644389:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663775488 00000100:00100000:0.0:1790779073.644432:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790779073.644440:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663775488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779073.644454:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779073.644492:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663775488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779073.644517:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790779073.644553:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663775488:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790779073.644623:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779073.658680:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779073.658721:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779073.659181:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642713728 00000100:00100000:1.0:1790779073.659190:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642713728 00000100:00100000:1.0:1790779073.659277:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:1.0:1790779073.659288:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+21:2401:x1877767642713728:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779073.659303:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779073.659326:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936cf53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257db expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.659344:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7703991600) 00010000:00010000:1.0:1790779073.659349:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779073.659410:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+20:2401:x1877767642713728:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 123us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779073.659434:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1790779073.659502:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642713600 00000100:00100000:0.0:1790779073.659507:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642713600 00000100:00100000:0.0:1790779073.659538:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:0.0:1790779073.659546:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+20:11143:x1877767642713600:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1790779073.659566:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779073.659581:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936cf61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257e2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.659676:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936cf68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.659692:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936cf68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.659702:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936cf68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779073.659714:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790779073.659823:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936cf61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257e2 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.659837:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936cf68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257e2 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.659845:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7703991600) 00010000:00010000:0.0:1790779073.659848:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790779073.659857:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768a00, rc 0) 00000100:00100000:0.0:1790779073.659927:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11143:x1877767642713600:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 382us (1257us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1790779073.659934:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1790779073.683779:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779073.683876:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642713856 00000100:00100000:0.0:1790779073.683921:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642713856 00000100:00100000:0.0:1790779073.683983:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:0.0:1790779073.683994:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642713856:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:0.0:1790779073.684041:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.684075:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.684084:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779073.684089:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790779073.684094:0:8439:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.684129:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.684145:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 7 pid: 8438 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779073.684158:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760384ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1877767663775616:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779073.684259:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030c0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779073.690179:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779073.690294:0:8443:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642713984 00000100:00100000:2.0:1790779073.690304:0:8443:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642713984 00002000:00100000:2.0:1790779073.690354:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9b7603bed180 x1877767642713984/t0(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:624/0 lens 504/0 e 0 to 0 dl 1790779084 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779073.690365:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603bed180 with x1877767642713984 ext(0->12) 00010000:00010000:2.0:1790779073.690376:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 8 pid: 8438 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.690391:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 8 pid: 8438 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779073.690399:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b7603bed180 00000100:00100000:2.0:1790779073.690453:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:2.0:1790779073.690464:0:8443:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2400:x1877767642713984:12345-192.168.203.3@tcp:4:lfs.0 00000100:00100000:0.0:1790779073.691566:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760384ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1877767663775616:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779073.691591:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1790779073.697058:0:9517:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000100:00100000:2.0:1790779073.698680:0:8443:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2400:x1877767642713984:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 8207us (8510us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790779073.698694:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00002000:00100000:2.0:1790779073.698707:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9b7603bed180 x1877767642713984/t4294967300(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:624/0 lens 504/448 e 0 to 0 dl 1790779084 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779073.698716:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603bed180 with x1877767642713984 ext(0->12) 00010000:00010000:2.0:1790779073.698727:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 9 pid: 8438 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.698746:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 9 pid: 8438 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779073.698753:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b7603bed180 00000100:00100000:2.0:1790779073.702933:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779073.703151:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642714112 00000100:00100000:1.0:1790779073.703162:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642714112 00010000:00010000:1.0:1790779073.703215:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 9 pid: 8438 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779073.703271:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:1.0:1790779073.703281:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2398:x1877767642714112:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779073.703296:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790779073.703314:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790779073.703316:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1790779072 00002000:00010000:1.0:1790779073.703319:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1790779073 00002000:00010000:1.0:1790779073.703321:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1790779072 00002000:00010000:1.0:1790779073.703322:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1790779073.703328:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 9 pid: 8438 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.703340:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 9 pid: 8438 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.703363:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f24387/0xb1aa4014e936cf29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257c6 expref: 9 pid: 8438 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.703379:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779073.703383:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779073.703403:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.703413:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.703457:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779073.703516:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2398:x1877767642714112:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 236us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779073.703523:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00010000:00010000:2.0:1790779073.703689:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.703698:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.703717:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.703725:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.703741:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.703748:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779073.703753:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.703761:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.703772:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.703779:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936cf76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779073.703819:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642713856:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 19828us (20049us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779073.703825:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:0.0:1790779073.726474:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779073.726562:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642714368 00000100:00100000:1.0:1790779073.726571:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642714368 00000100:00100000:1.0:1790779073.726633:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:1.0:1790779073.726644:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11143:x1877767642714368:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:1.0:1790779073.726704:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936cf68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257e2 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779073.726974:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1790779073.727030:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1790779073.727377:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1790779073.727418:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.727434:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936cf0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b8 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.727444:0:6526:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.727492:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936cf0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b8 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.727506:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936cf0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b8 expref: 26 pid: 6524 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779073.727521:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603967480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1877767663775744:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779073.727631:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81300 going to sleep for 11 seconds 00000100:00100000:3.0:1790779073.738930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779073.739122:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642714496 00000100:00100000:0.0:1790779073.739132:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642714496 00010000:00010000:0.0:1790779073.739186:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936cf0d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b8 expref: 27 pid: 6524 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779073.739236:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:0.0:1790779073.739246:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+27:2401:x1877767642714496:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779073.739521:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779073.739529:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936cf0d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b8 expref: 27 pid: 6524 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.739545:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936cf0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b8 expref: 27 pid: 6524 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.739568:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7703991600) 00010000:00010000:0.0:1790779073.739574:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.739585:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.739593:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.739632:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779073.739693:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+27:2401:x1877767642714496:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 448us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779073.739700:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00010000:00010000:1.0:1790779073.741480:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936cf0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b8 expref: 26 pid: 6524 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779073.741507:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603967480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1877767663775744:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779073.741534:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.741544:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.741550:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779073.741657:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1790779073.741755:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1790779073.741850:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603967480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663775872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790779073.743210:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779073.743514:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779073.745996:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663775872 00000100:00100000:2.0:1790779073.746012:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663775872 00000100:00100000:2.0:1790779073.746130:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790779073.746139:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1877767663775872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790779073.746314:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1877767663775872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 176us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779073.746339:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790779073.746604:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603967480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663775872:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790779073.746775:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1790779073.746844:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603beed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663776000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790779073.746910:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779073.746928:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854b480 going to sleep for 11 seconds 00000100:00100000:0.0:1790779073.747191:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663776000 00000100:00100000:0.0:1790779073.747197:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663776000 00000100:00100000:0.0:1790779073.747238:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790779073.747246:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6526:x1877767663776000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790779073.747379:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6526:x1877767663776000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 134us (468us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790779073.747386:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790779073.747618:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603beed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663776000:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790779073.747661:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1790779073.747699:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.747711:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.747719:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.747725:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779073.747742:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.747751:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.747766:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7703991600) 00010000:00010000:3.0:1790779073.747768:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790779073.747773:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779073.747779:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cf7d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790779073.747873:0:6526:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790779073.747953:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1790779073.747964:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391755083661ns, next at 392755081859ns, rc = 0 00000001:00080000:3.0:1790779073.747970:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1790779073.747992:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7703991600) 00010000:00010000:3.0:1790779073.747995:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790779073.748002:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936cf68 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257e2 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779073.748108:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11143:x1877767642714368:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 21466us (21644us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1790779073.748121:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000020:00080000:3.0:1790779073.748124:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1790779073.755664:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779073.760060:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779073.760160:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642714624 00000100:00100000:1.0:1790779073.760181:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642714624 00000100:00100000:1.0:1790779073.760254:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:1.0:1790779073.760265:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11143:x1877767642714624:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779073.760291:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779073.760314:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936cf84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257e9 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.760377:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936cf84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257e9 expref: 30 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.760390:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936cf84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257e9 expref: 30 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779073.760408:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:1.0:1790779073.760412:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779073.760415:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055ce800, rc 0) 00000100:00100000:1.0:1790779073.760478:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11143:x1877767642714624:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 215us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779073.760487:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:0.0:1790779073.770580:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779073.771461:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642714880 00000100:00100000:2.0:1790779073.771474:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642714880 00000100:00100000:2.0:1790779073.771539:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:2.0:1790779073.771549:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718264850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11143:x1877767642714880:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779073.771806:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718264850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+31:11143:x1877767642714880:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 258us (1236us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1790779073.771813:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:2.0:1790779073.976050:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779073.976148:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642715136 00000100:00100000:0.0:1790779073.976158:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642715136 00000100:00100000:0.0:1790779073.976229:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:0.0:1790779073.976239:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+31:11153:x1877767642715136:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1790779073.976284:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779073.976306:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936cf8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257f0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779073.976406:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1790779073.976506:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936cf8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257f0 expref: 33 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.976519:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603618200) 00010000:00010000:0.0:1790779073.976522:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790779073.976539:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936cf8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257f0 expref: 33 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779073.977006:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769e00, rc 0) 00000100:00100000:0.0:1790779073.977077:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+32:11153:x1877767642715136:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 839us (1035us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1790779073.977086:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:0.0:1790779073.996261:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779073.996456:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642715264 00000100:00100000:2.0:1790779073.996467:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642715264 00000100:00100000:2.0:1790779073.996528:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:2.0:1790779073.996539:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+32:11153:x1877767642715264:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:2.0:1790779073.996629:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936cf99 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.996648:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936cf99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.996663:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936cf99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.996675:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cfa0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.996683:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cfa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.996690:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cfa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.996941:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cfa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.996951:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.996958:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779073.997003:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997015:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936cf99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997021:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936cf99 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997028:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936cf99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997034:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ba00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779073.997038:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936cf99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997046:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936cf99 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997057:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:2.0:1790779073.997060:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779073.997065:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936cf99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997077:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936cf99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997090:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cfa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997097:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cfa0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997103:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cfa0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997108:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ae00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779073.997111:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cfa0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997117:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cfa0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997125:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7703991b00) 00010000:00010000:2.0:1790779073.997127:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779073.997130:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cfa0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997136:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936cfa0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997147:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997153:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cfa7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997165:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cfa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997169:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779073.997172:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cfa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997178:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cfa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997186:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779073.997188:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779073.997191:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cfa7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779073.997198:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936cfa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779073.997451:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+32:11153:x1877767642715264:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 912us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779073.997460:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:2.0:1790779074.018174:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779074.018489:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642715520 00000100:00100000:0.0:1790779074.018500:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642715520 00000100:00100000:0.0:1790779074.018582:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1790779074.018594:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+32:11153:x1877767642715520:12345-192.168.203.3@tcp:35:lfs.0 00000100:00080000:1.0:1790779074.018842:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779074.019057:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+33:11153:x1877767642715520:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 464us (901us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1790779074.019065:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1790779074.127766:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779074.128242:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642715776 00000100:00100000:1.0:1790779074.128270:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642715776 00000100:00100000:1.0:1790779074.128351:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1790779074.128362:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+33:11156:x1877767642715776:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779074.128390:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779074.128411:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cfae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257f7 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128524:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cfb5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128538:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cfb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128550:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cfb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128562:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936cfbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128568:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936cfbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128574:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936cfbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128684:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936cfc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128693:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936cfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128699:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936cfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779074.128709:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790779074.128783:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cfb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128802:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cfb5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128808:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cfb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128814:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779074.128818:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cfb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128826:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cfb5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128838:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:1.0:1790779074.128841:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779074.128846:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cfb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128851:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936cfb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128864:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936cfbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128870:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936cfbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128923:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936cfbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128930:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cfc00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779074.128939:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936cfbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128946:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936cfbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128954:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7703991b00) 00010000:00010000:1.0:1790779074.128957:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779074.128960:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936cfbc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.128966:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936cfbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.129006:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936cfae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257f7 expref: 36 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.129019:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936cfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257f7 expref: 35 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.129026:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:1.0:1790779074.129028:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779074.129030:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cea00, rc 0) 00000100:00100000:1.0:1790779074.129096:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+35:11156:x1877767642715776:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 735us (1349us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1790779074.129104:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:3.0:1790779074.132222:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779074.135543:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642715904 00000100:00100000:1.0:1790779074.135558:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642715904 00000100:00100000:1.0:1790779074.135635:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:1.0:1790779074.135646:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+35:11156:x1877767642715904:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:1.0:1790779074.135740:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cfd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.135760:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.135773:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.135811:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.135818:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cfd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.135826:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.135833:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779074.135837:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.135846:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cfd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.135858:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:1.0:1790779074.135861:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790779074.135866:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cfd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.135872:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936cfd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779074.135988:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+35:11156:x1877767642715904:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 343us (3774us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779074.135996:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:2.0:1790779074.154788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779074.155088:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642716160 00000100:00100000:3.0:1790779074.155112:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642716160 00000100:00100000:3.0:1790779074.155177:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1790779074.155189:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+35:11156:x1877767642716160:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779074.155444:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+36:11156:x1877767642716160:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 257us (665us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1790779074.155452:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00010000:00010000:3.0:1790779074.473288:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779074.664533:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663776384:0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.664574:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663776256:0@lo:400:kworker.0 00000100:00100000:3.0:1790779074.664607:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779074.664607:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779074.664686:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663776512:0@lo:400:kworker.0 00000100:00100000:0.0:1790779074.664823:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663776128:0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.679137:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663776768:0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.679204:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779074.679238:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663777280:0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.679289:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779074.679321:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663777792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779074.679347:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779074.679372:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779074.679379:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663777920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779074.679401:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779074.679438:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663777792 00000100:00100000:2.0:1790779074.679446:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663777792 00000100:00100000:2.0:1790779074.679499:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663777920 00000100:00100000:2.0:1790779074.679502:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663777920 00000100:00100000:2.0:1790779074.679517:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790779074.679524:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663777792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790779074.679547:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779074.679592:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663777792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779074.679600:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790779074.679616:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790779074.679623:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663777920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790779074.679632:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779074.679656:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663777920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779074.679662:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790779074.679678:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663776256 00000100:00100000:2.0:1790779074.679682:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663776256 00000100:00100000:2.0:1790779074.679728:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663776768 00000100:00100000:2.0:1790779074.679731:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663776768 00000100:00100000:2.0:1790779074.679750:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663777280 00000100:00100000:2.0:1790779074.679759:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663777280 00000100:00100000:2.0:1790779074.679783:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1790779074.679789:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663776256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.679822:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663776256:12345-0@lo:400:kworker.0 Request processed in 33us (15215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779074.679829:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1790779074.679840:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1790779074.679846:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663776768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.683004:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663776768:12345-0@lo:400:kworker.0 Request processed in 26us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779074.683028:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1790779074.683071:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790779074.683087:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663777280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.683183:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663777280:12345-0@lo:400:kworker.0 Request processed in 105us (3893us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779074.683189:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:2.0:1790779074.683216:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779074.683223:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779074.683294:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663777920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779074.683316:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76039b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663777792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779074.683329:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663776256:0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.683341:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663776768:0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.683351:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663777280:0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.683444:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663776384 00000100:00100000:2.0:1790779074.683467:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663776384 00000100:00100000:2.0:1790779074.683509:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790779074.683517:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663776384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.683557:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663776384:12345-0@lo:400:kworker.0 Request processed in 41us (18950us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779074.683563:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790779074.691812:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663776384:0@lo:400:kworker.0 00000100:00100000:3.0:1790779074.691831:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76035c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663776896:0@lo:400:kworker.0 00000100:00100000:3.0:1790779074.691911:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779074.691936:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663777408:0@lo:400:kworker.0 00000100:00100000:3.0:1790779074.691958:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779074.692022:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663776896 00000100:00100000:3.0:1790779074.692029:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663776896 00000100:00100000:3.0:1790779074.692074:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663777408 00000100:00100000:3.0:1790779074.692077:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663777408 00000100:00100000:3.0:1790779074.692098:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1790779074.692106:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663776896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779074.692156:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663776896:12345-0@lo:400:kworker.0 Request processed in 51us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779074.692162:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1790779074.692178:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1790779074.692183:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663777408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779074.692615:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663777408:12345-0@lo:400:kworker.0 Request processed in 431us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779074.692624:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:3.0:1790779074.692648:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790779074.692671:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76035c4e00 x1877767663776896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779074.692682:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76035c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663776896:0@lo:400:kworker.0 00010000:00080000:3.0:1790779074.692691:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77108a4e00 x1877767663777408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779074.692698:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663777408:0@lo:400:kworker.0 00000100:00100000:1.0:1790779074.693549:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779074.693594:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76035c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663777024:0@lo:400:kworker.0 00000100:00100000:1.0:1790779074.693628:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779074.693663:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663777536:0@lo:400:kworker.0 00000100:00100000:1.0:1790779074.693683:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779074.693709:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663777024 00000100:00100000:1.0:1790779074.693714:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663777024 00000100:00100000:1.0:1790779074.693750:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663777536 00000100:00100000:1.0:1790779074.693753:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663777536 00000100:00100000:1.0:1790779074.693774:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790779074.693781:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663777024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779074.693824:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663777024:12345-0@lo:400:kworker.0 Request processed in 43us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779074.693829:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790779074.693843:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790779074.693849:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663777536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779074.693893:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663777536:12345-0@lo:400:kworker.0 Request processed in 28us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779074.693900:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790779074.693938:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663777536:0@lo:400:kworker.0 00000100:00100000:1.0:1790779074.693977:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76035c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663777024:0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.694190:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663776512 00000100:00100000:2.0:1790779074.694195:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663776512 00000100:00100000:2.0:1790779074.694229:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1790779074.694238:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663776512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.694288:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663776512:12345-0@lo:400:kworker.0 Request processed in 52us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779074.694294:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1790779074.694371:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663776512:0@lo:400:kworker.0 00000100:00100000:0.0:1790779074.715429:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779074.715519:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663776640:0@lo:400:kworker.0 00000100:00100000:0.0:1790779074.715560:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779074.715580:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76035c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663777152:0@lo:400:kworker.0 00000100:00100000:0.0:1790779074.715600:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779074.715625:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663777664:0@lo:400:kworker.0 00000100:00100000:0.0:1790779074.715647:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779074.715679:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663777152 00000100:00100000:0.0:1790779074.715687:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663777152 00000100:00100000:0.0:1790779074.715740:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663777664 00000100:00100000:0.0:1790779074.715744:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663777664 00000100:00100000:0.0:1790779074.715764:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790779074.715772:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663777152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779074.715823:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663777152:12345-0@lo:400:kworker.0 Request processed in 51us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779074.715829:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790779074.715846:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790779074.715852:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663777664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779074.715900:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663777664:12345-0@lo:400:kworker.0 Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779074.715906:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790779074.715944:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663777664:0@lo:400:kworker.0 00000100:00100000:0.0:1790779074.715971:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76035c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663777152:0@lo:400:kworker.0 00000100:00100000:3.0:1790779074.717015:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663776128 00000100:00100000:3.0:1790779074.717024:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663776128 00000100:00100000:3.0:1790779074.717075:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1790779074.717084:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771829fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663776128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779074.717147:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771829fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663776128:12345-0@lo:400:kworker.0 Request processed in 65us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779074.717153:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1790779074.717376:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663776640 00000100:00100000:2.0:1790779074.717381:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663776640 00000100:00100000:2.0:1790779074.717420:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790779074.717427:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663776640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779074.717466:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663776640:12345-0@lo:400:kworker.0 Request processed in 41us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779074.717473:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790779074.718412:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663776128:0@lo:400:kworker.0 00000100:00100000:0.0:1790779074.718429:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663776640:0@lo:400:kworker.0 00000100:00100000:0.0:1790779074.748462:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779074.748537:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642716416 00000100:00100000:3.0:1790779074.748548:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642716416 00000100:00100000:3.0:1790779074.748619:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:3.0:1790779074.748629:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+36:11188:x1877767642716416:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:3.0:1790779074.748657:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779074.748677:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936cfd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4257fe expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.748813:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936cfdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.748841:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936cfdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.748853:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936cfdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779074.748866:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790779074.749336:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936cfd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257fe expref: 39 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.749361:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936cfdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257fe expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.749373:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:3.0:1790779074.749376:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779074.749381:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663000, rc 0) 00000100:00100000:3.0:1790779074.749500:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+38:11188:x1877767642716416:12345-192.168.203.3@tcp:101:cat.0 Request processed in 872us (1048us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1790779074.749508:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1790779074.759812:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779074.759933:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779074.759988:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642716800 00000100:00100000:1.0:1790779074.759998:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642716800 00000100:00100000:1.0:1790779074.760063:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:1.0:1790779074.760074:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+38:2399:x1877767642716800:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779074.760090:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779074.760114:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936cfdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257fe expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779074.760131:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:1.0:1790779074.760136:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779074.760202:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+37:2399:x1877767642716800:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 129us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779074.760214:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:2.0:1790779074.761447:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642716672 00000100:00100000:2.0:1790779074.761456:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642716672 00000100:00100000:2.0:1790779074.761510:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:2.0:1790779074.761521:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+37:11188:x1877767642716672:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:2.0:1790779074.761782:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+38:11188:x1877767642716672:12345-192.168.203.3@tcp:35:cat.0 Request processed in 263us (1978us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1790779074.761790:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:0.0:1790779074.883944:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779074.884077:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642717056 00000100:00100000:3.0:1790779074.884088:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642717056 00000100:00100000:3.0:1790779074.884157:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:3.0:1790779074.884168:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+38:11194:x1877767642717056:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:3.0:1790779074.884194:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779074.884211:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790779074.884250:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936cf45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257d4 expref: 38 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.884282:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779074.884287:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779074.884303:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936cfed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425805 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.884411:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.884425:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936cfc3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257f7 expref: 38 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.884433:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.884464:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936cfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257f7 expref: 38 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.884477:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936cfc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257f7 expref: 38 pid: 13003 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779074.884490:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663778048:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779074.884987:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7710897cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779074.899703:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663778048:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779074.899736:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779074.905157:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779074.905267:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642717184 00000100:00100000:2.0:1790779074.905277:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642717184 00010000:00010000:2.0:1790779074.905318:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936cfc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257f7 expref: 39 pid: 13003 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779074.905358:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:2.0:1790779074.905367:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+39:2400:x1877767642717184:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779074.905382:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779074.905388:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936cfc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257f7 expref: 39 pid: 13003 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.905401:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936cfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257f7 expref: 39 pid: 13003 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.905420:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936cfc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257f7 expref: 39 pid: 13003 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.905435:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779074.905440:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.905449:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.905456:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.905488:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779074.905548:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+38:2400:x1877767642717184:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 181us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779074.905570:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00010000:00010000:3.0:1790779074.905730:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.905738:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779074.905755:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790779074.905932:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936cfed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425805 expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.905951:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425805 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.905959:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:3.0:1790779074.905962:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790779074.905964:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662c00, rc 0) 00000100:00100000:3.0:1790779074.905999:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+38:11194:x1877767642717056:12345-192.168.203.3@tcp:101:dd.0 Request processed in 21833us (22065us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1790779074.906007:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:0.0:1790779074.911288:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779074.911384:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642717312 00000100:00100000:2.0:1790779074.911395:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642717312 00000100:00100000:2.0:1790779074.911458:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:2.0:1790779074.911468:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+38:11194:x1877767642717312:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1790779074.911494:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779074.911514:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d002 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42580c expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.911562:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d009 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.911577:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.911588:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.911707:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d002 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42580c expref: 40 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.911726:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d009 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42580c expref: 39 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.911735:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779074.911738:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790779074.911741:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894a400, rc 0) 00000100:00100000:2.0:1790779074.911809:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+39:11194:x1877767642717312:12345-192.168.203.3@tcp:101:dd.0 Request processed in 342us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779074.911823:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:2.0:1790779074.923769:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779074.926476:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642717568 00000100:00100000:3.0:1790779074.926490:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642717568 00000100:00100000:3.0:1790779074.926781:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:3.0:1790779074.926794:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+39:11194:x1877767642717568:12345-192.168.203.3@tcp:36:dd.0 00010000:00010000:3.0:1790779074.927077:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.927099:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.927130:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790779074.927193:0:6524:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1790779074.927235:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002848c0e2 reply state 00000000a127c46f transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.927259:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779074.927268:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:3.0:1790779074.927271:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790779074.927276:0:6524:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790779074.927404:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+42:11194:x1877767642717568:12345-192.168.203.3@tcp:36:dd.0 Request processed in 613us (3643us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1790779074.927413:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000020:00080000:3.0:1790779074.927420:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1790779074.937704:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967337 is committed 00000004:00080000:1.0:1790779074.937742:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1790779074.937757:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b771854b300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1790779074.937762:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b7603389b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b771854bb40 00000020:00080000:1.0:1790779074.937765:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b7603389900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7709d42600 00000020:00080000:2.0:1790779074.938034:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1790779074.938301:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1790779074.938358:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938369:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938376:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938382:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779074.938388:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938396:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938414:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b7703991e00) 00010000:00010000:2.0:1790779074.938417:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779074.938422:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938428:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936cec0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938452:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938467:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938472:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938476:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779074.938479:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938485:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938492:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:2.0:1790779074.938494:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779074.938497:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.938501:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936cec7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779074.938681:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663778176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790779074.938751:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790779074.940433:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.940452:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.940460:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.940466:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779074.940488:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.940497:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.940514:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7703991b00) 00000100:00100000:0.0:1790779074.940730:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663778176 00000100:00100000:0.0:1790779074.940740:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663778176 00000100:00100000:0.0:1790779074.940795:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790779074.940804:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663778176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790779074.940842:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1790779074.940873:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6abd1ec0, atime: 0x6abd1ec1, ctime: 0x6abd1ec0, blocks: 0x8 00010000:00010000:0.0:1790779074.940898:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d599a1e1/0xb1aa4014e936d017 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779074.940913:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=392s v=(0 0) 00010000:00010000:0.0:1790779074.940917:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779074.940924:0:8439:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d599a1e1/0xb1aa4014e936d017 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779074.940938:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d599a1e1/0xb1aa4014e936d017 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779074.940946:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d599a1e1/0xb1aa4014e936d017 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779074.940952:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d599a1e1/0xb1aa4014e936d017 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779074.940969:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790779074.941148:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3651:x1877767663778176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 344us (2397us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790779074.941156:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1790779074.941184:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779074.941190:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d599a1e1/0xb1aa4014e936d017 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.941480:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779074.941487:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.941495:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936cf06 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790779074.941740:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603843100/2, rc 0, transno 4294967302 00000100:00100000:1.0:1790779074.941747:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663778176:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1790779074.941804:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.941811:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.941817:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.941823:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779074.941827:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.941833:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.941845:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779074.941849:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779074.941859:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779074.941865:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d010 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779074.941958:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779074.941963:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d599a1e1/0xb1aa4014e936d017 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779074.941971:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d599a1e1/0xb1aa4014e936d017 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779074.941984:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d599a1e1/0xb1aa4014e936d017 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779074.941990:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d599a1e1/0xb1aa4014e936d017 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779074.942006:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779074.942008:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779074.942010:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779075.176357:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779075.176382:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663778304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779075.176451:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779075.176615:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663778304 00000100:00100000:0.0:1790779075.176623:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663778304 00000100:00100000:0.0:1790779075.176680:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790779075.176690:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663778304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779075.176730:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790779075.176801:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663778304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779075.176808:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790779075.176966:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663778304:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790779075.496174:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779075.501975:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779075.502087:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642717696 00000100:00100000:2.0:1790779075.502097:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642717696 00000100:00100000:2.0:1790779075.502167:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1790779075.502178:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+12:11208:x1877767642717696:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:2.0:1790779075.502206:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779075.502228:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d01e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425813 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.502568:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d025 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.502583:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d025 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.502594:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d025 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.502610:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d02c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.502617:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d02c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.502633:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d02c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.502702:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.502714:0:13821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425805 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.502722:0:13821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.502753:0:13821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425805 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.502768:0:13821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425805 expref: 13 pid: 6523 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779075.502782:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663778432:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779075.502987:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854b480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779075.508053:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663778432:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779075.508095:0:13821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779075.510963:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779075.511815:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642717952 00000100:00100000:2.0:1790779075.511824:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642717952 00000100:00100000:2.0:1790779075.511956:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:2.0:1790779075.511967:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+14:6167:x1877767642717952:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790779075.512333:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+15:6167:x1877767642717952:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 368us (1379us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1790779075.512341:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:1.0:1790779075.518493:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779075.518632:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642718080 00000100:00100000:0.0:1790779075.518642:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642718080 00010000:00010000:0.0:1790779075.518685:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425805 expref: 15 pid: 6523 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779075.518726:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:0.0:1790779075.518736:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+15:2401:x1877767642718080:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779075.518749:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779075.518756:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425805 expref: 15 pid: 6523 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779075.518769:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425805 expref: 15 pid: 6523 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779075.518789:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936cff4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425805 expref: 15 pid: 6523 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779075.518805:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:0.0:1790779075.518810:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779075.518821:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779075.518828:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779075.518863:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779075.518977:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+14:2401:x1877767642718080:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 242us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779075.518985:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00010000:00010000:2.0:1790779075.519195:0:13821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519205:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779075.519268:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790779075.519273:0:13821:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779075.519312:0:13821:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519324:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519333:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d025 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519340:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d025 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519346:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d025 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519351:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779075.519355:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d025 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519361:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d025 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519378:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:2.0:1790779075.519380:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779075.519385:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d025 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519391:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d025 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519535:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d02c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519541:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d02c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519547:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d02c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519552:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ba00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779075.519556:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d02c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519561:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d02c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519568:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7712a95300) 00010000:00010000:2.0:1790779075.519571:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779075.519574:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d02c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519579:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d02c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519624:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d01e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425813 expref: 14 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519637:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425813 expref: 13 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.519644:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779075.519646:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779075.519649:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894ae00, rc 0) 00000100:00100000:2.0:1790779075.519690:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+13:11208:x1877767642717696:12345-192.168.203.3@tcp:101:stat.0 Request processed in 17514us (17726us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779075.519698:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:1.0:1790779075.611938:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779075.612044:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642718336 00000100:00100000:2.0:1790779075.612054:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642718336 00000100:00100000:2.0:1790779075.612112:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1790779075.612122:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+13:11214:x1877767642718336:12345-192.168.203.3@tcp:36:truncate.0 00010000:00010000:2.0:1790779075.612176:0:10428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779075.612200:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d033 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425813 expref: 13 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.612221:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779075.612227:0:10428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779075.612408:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.612422:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.612444:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790779075.612487:0:10428:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1790779075.612509:0:10428:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002e4e6ff7 reply state 00000000876fede0 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.612522:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779075.612528:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779075.612531:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779075.612534:0:10428:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790779075.612640:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+15:11214:x1877767642718336:12345-192.168.203.3@tcp:36:truncate.0 Request processed in 519us (711us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1790779075.612648:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000020:00080000:2.0:1790779075.612653:0:10428:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790779075.776575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779075.776829:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642718464 00000100:00100000:3.0:1790779075.776839:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642718464 00000100:00100000:3.0:1790779075.776920:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1790779075.776931:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+15:11228:x1877767642718464:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:3.0:1790779075.776958:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779075.776978:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d041 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42581a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777043:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d048 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777059:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d048 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777088:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d048 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777103:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d04f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777111:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d04f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777118:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d04f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777320:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777332:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777338:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779075.777378:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1790779075.777384:0:6525:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779075.777536:0:6525:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777548:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777557:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d048 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777573:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d048 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777580:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d048 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777586:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779075.777591:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d048 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777599:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d048 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777610:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779075.777613:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779075.777628:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d048 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777634:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d048 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777647:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d04f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777652:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d04f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777657:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d04f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777662:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779075.777680:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d04f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777688:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d04f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777695:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7705528300) 00010000:00010000:3.0:1790779075.777698:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779075.777701:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d04f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777706:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d04f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777745:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d041 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42581a expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777758:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42581a expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.777764:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:3.0:1790779075.777767:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779075.777769:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662c00, rc 0) 00000100:00100000:3.0:1790779075.777834:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+16:11228:x1877767642718464:12345-192.168.203.3@tcp:101:stat.0 Request processed in 905us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779075.777841:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:0.0:1790779075.887826:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779075.887939:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642718720 00000100:00100000:3.0:1790779075.887950:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642718720 00000100:00100000:3.0:1790779075.888021:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:3.0:1790779075.888032:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+16:11238:x1877767642718720:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779075.888071:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779075.888093:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d05d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425821 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779075.888242:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1790779075.888363:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d05d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425821 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.888377:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603618200) 00010000:00010000:3.0:1790779075.888380:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790779075.888385:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d05d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425821 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779075.888400:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662000, rc 0) 00000100:00100000:3.0:1790779075.888469:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+17:11238:x1877767642718720:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 438us (652us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1790779075.888476:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:3.0:1790779075.896330:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779075.897093:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642718976 00000100:00100000:0.0:1790779075.897106:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642718976 00000100:00100000:0.0:1790779075.897175:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1790779075.897186:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+17:11238:x1877767642718976:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1790779075.897739:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+18:11238:x1877767642718976:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 554us (1417us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1790779075.897748:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1790779076.011749:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779076.011859:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642719232 00000100:00100000:2.0:1790779076.011870:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642719232 00000100:00100000:2.0:1790779076.012018:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:2.0:1790779076.012029:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+18:11244:x1877767642719232:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1790779076.012051:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779076.012070:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d06b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425828 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.012186:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.012207:0:10428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42581a expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.012223:0:10428:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.012271:0:10428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42581a expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.012284:0:10428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42581a expref: 19 pid: 6525 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779076.012297:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663778560:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779076.012427:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720163900 going to sleep for 11 seconds 00000100:00080000:3.0:1790779076.012547:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779076.015806:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663778560:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779076.015843:0:10428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779076.019693:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779076.019791:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642719360 00000100:00100000:2.0:1790779076.019802:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642719360 00010000:00010000:2.0:1790779076.019844:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42581a expref: 20 pid: 6525 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779076.019910:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:2.0:1790779076.019920:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+20:2401:x1877767642719360:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779076.019934:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779076.019940:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42581a expref: 20 pid: 6525 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.019952:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42581a expref: 20 pid: 6525 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.019976:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d056 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42581a expref: 20 pid: 6525 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.020010:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779076.020015:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.020025:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.020032:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.020065:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779076.020130:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+19:2401:x1877767642719360:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 211us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779076.020138:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00010000:00010000:1.0:1790779076.020813:0:10428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.020824:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779076.020842:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1790779076.021008:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d06b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425828 expref: 20 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.021026:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425828 expref: 19 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.021033:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:1.0:1790779076.021036:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790779076.021039:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b600, rc 0) 00000100:00100000:1.0:1790779076.021082:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+19:11244:x1877767642719232:12345-192.168.203.3@tcp:101:bash.0 Request processed in 9056us (9343us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1790779076.021089:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:0.0:1790779076.024586:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779076.024975:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642719616 00000100:00100000:2.0:1790779076.024986:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642719616 00000100:00100000:2.0:1790779076.025087:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:2.0:1790779076.025097:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+19:11244:x1877767642719616:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:2.0:1790779076.025370:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.025393:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.025406:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790779076.025450:0:6524:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1790779076.025470:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c3ccbade reply state 00000000ce0476c2 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.025498:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.025506:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779076.025508:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779076.025512:0:6524:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790779076.025658:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11244:x1877767642719616:12345-192.168.203.3@tcp:36:bash.0 Request processed in 561us (1083us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1790779076.025666:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00000020:00080000:2.0:1790779076.025672:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790779076.035607:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779076.035711:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642719744 00000100:00100000:3.0:1790779076.035722:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642719744 00000100:00100000:3.0:1790779076.035814:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:3.0:1790779076.035824:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11244:x1877767642719744:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779076.035847:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779076.035865:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d087 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42582f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.036009:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d08e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.036025:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425828 expref: 23 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.036034:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d08e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.036072:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425828 expref: 23 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.036085:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425828 expref: 23 pid: 10428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779076.036100:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663778688:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779076.036174:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720167840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779076.039163:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779076.039385:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663778688:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779076.039415:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d08e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779076.039540:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642719872 00000100:00100000:2.0:1790779076.039548:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642719872 00010000:00010000:2.0:1790779076.039585:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425828 expref: 24 pid: 10428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779076.039627:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:2.0:1790779076.039636:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+24:2401:x1877767642719872:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779076.039651:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779076.039657:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425828 expref: 24 pid: 10428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.039669:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425828 expref: 24 pid: 10428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.039690:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d072 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425828 expref: 24 pid: 10428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.039724:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779076.039728:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d08e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.039737:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d08e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.039744:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d08e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.039855:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779076.039950:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+23:2401:x1877767642719872:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 314us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779076.039958:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00010000:00010000:3.0:1790779076.041410:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d08e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.041422:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d08e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779076.041747:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790779076.041752:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779076.041772:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d08e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.041803:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d087 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42582f expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.041821:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d08e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42582f expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.041830:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779076.041833:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779076.041836:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663400, rc 0) 00000100:00100000:2.0:1790779076.041985:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11244:x1877767642719744:12345-192.168.203.3@tcp:101:bash.0 Request processed in 6162us (6525us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779076.041994:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:0.0:1790779076.044983:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779076.045429:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642720128 00000100:00100000:2.0:1790779076.045439:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642720128 00000100:00100000:2.0:1790779076.045532:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1790779076.045541:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718266450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11244:x1877767642720128:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:2.0:1790779076.045763:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718266450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+23:11244:x1877767642720128:12345-192.168.203.3@tcp:35:bash.0 Request processed in 222us (884us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1790779076.045771:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:0.0:1790779076.142147:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779076.142277:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642720384 00000100:00100000:1.0:1790779076.142301:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642720384 00000100:00100000:1.0:1790779076.142363:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:1.0:1790779076.142374:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+23:11254:x1877767642720384:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779076.142397:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779076.142420:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425836 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779076.142536:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790779076.142631:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d095 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425836 expref: 25 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.142645:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603618200) 00010000:00010000:1.0:1790779076.142648:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790779076.142654:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425836 expref: 25 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.142669:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055ce600, rc 0) 00000100:00100000:1.0:1790779076.142733:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+24:11254:x1877767642720384:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 361us (595us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1790779076.142740:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:1.0:1790779076.147632:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779076.147834:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642720512 00000100:00100000:3.0:1790779076.147856:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642720512 00000100:00100000:3.0:1790779076.147955:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:3.0:1790779076.147965:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+24:11254:x1877767642720512:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:3.0:1790779076.148044:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d0a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148063:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d0a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148076:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d0a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148091:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d0aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148098:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d0aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148103:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d0aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148187:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d0b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148197:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148204:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779076.148261:0:6525:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148285:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d0a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148292:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d0a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148299:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d0a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148304:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779076.148308:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d0a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148316:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d0a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148329:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779076.148331:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779076.148337:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d0a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148343:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d0a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148357:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d0aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148363:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d0aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148368:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d0aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148382:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779076.148385:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d0aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148392:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d0aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148400:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7705528300) 00010000:00010000:3.0:1790779076.148403:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779076.148406:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d0aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148412:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d0aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148426:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148433:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d0b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148438:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148443:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779076.148446:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148452:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d0b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148469:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:3.0:1790779076.148471:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779076.148474:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d0b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.148479:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d0b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779076.148578:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+24:11254:x1877767642720512:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 613us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779076.148585:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:0.0:1790779076.153059:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779076.153156:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642720768 00000100:00100000:3.0:1790779076.153167:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642720768 00000100:00100000:3.0:1790779076.153692:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1790779076.153704:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+24:11254:x1877767642720768:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779076.153939:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+25:11254:x1877767642720768:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 237us (888us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1790779076.153947:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:0.0:1790779076.202980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779076.203073:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642721024 00000100:00100000:2.0:1790779076.203085:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642721024 00000100:00100000:2.0:1790779076.203160:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:2.0:1790779076.203170:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+25:11257:x1877767642721024:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779076.203193:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779076.203223:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d0b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42583d expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203316:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d0bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203331:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d0bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203342:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d0bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203358:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d0c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203377:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203384:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203482:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d0cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203491:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d0cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203497:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d0cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779076.203505:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790779076.203572:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d0bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203579:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d0bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203585:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d0bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203590:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ae00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779076.203594:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d0bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203601:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d0bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203620:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:2.0:1790779076.203622:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779076.203627:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d0bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203633:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d0bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203649:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203654:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d0c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203660:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d0c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203665:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ba00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779076.203668:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d0c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203674:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d0c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203681:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7712a95300) 00010000:00010000:2.0:1790779076.203683:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779076.203685:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d0c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203691:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d0c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203740:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d0b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42583d expref: 28 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203754:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d0cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42583d expref: 27 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.203761:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779076.203763:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779076.203766:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3a00, rc 0) 00000100:00100000:2.0:1790779076.203830:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+27:11257:x1877767642721024:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 662us (859us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790779076.203838:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:0.0:1790779076.209099:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779076.209159:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779076.209292:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642721152 00000100:00100000:1.0:1790779076.209304:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642721152 00000100:00100000:1.0:1790779076.209374:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:1.0:1790779076.209385:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+27:11257:x1877767642721152:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:1.0:1790779076.209464:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d0db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.209500:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.209511:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.209545:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.209552:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d0db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.209559:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d0db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.209565:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779076.209569:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d0db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.209576:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d0db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.209586:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:1.0:1790779076.209589:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790779076.209593:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d0db lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.209598:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d0db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779076.209669:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+27:11257:x1877767642721152:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 286us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779076.209683:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:2.0:1790779076.211249:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642721280 00000100:00100000:2.0:1790779076.211359:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642721280 00000100:00100000:2.0:1790779076.211426:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:2.0:1790779076.211436:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+27:2400:x1877767642721280:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779076.211450:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779076.211472:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d0cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42583d expref: 27 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.211489:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779076.211493:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779076.211597:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+26:2400:x1877767642721280:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 162us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779076.211605:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1790779076.213912:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779076.214610:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642721536 00000100:00100000:2.0:1790779076.214621:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642721536 00000100:00100000:2.0:1790779076.214687:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1790779076.214696:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+26:11257:x1877767642721536:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779076.215257:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+27:11257:x1877767642721536:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 225us (1049us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1790779076.215269:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1790779076.368667:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779076.368800:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642721792 00000100:00100000:2.0:1790779076.368811:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642721792 00000100:00100000:2.0:1790779076.368958:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:2.0:1790779076.368969:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+27:11275:x1877767642721792:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:2.0:1790779076.368992:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779076.369011:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d0e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425844 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.369119:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d0e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.369133:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d0e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.369144:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d0e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779076.369166:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790779076.369281:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d0e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425844 expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.369301:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d0e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425844 expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.369326:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779076.369329:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790779076.369332:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2000, rc 0) 00000100:00100000:2.0:1790779076.369389:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11275:x1877767642721792:12345-192.168.203.3@tcp:101:cat.0 Request processed in 422us (896us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1790779076.369396:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:0.0:1790779076.405480:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779076.405647:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642721920 00000100:00100000:2.0:1790779076.405658:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642721920 00000100:00100000:2.0:1790779076.405748:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:2.0:1790779076.405759:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11276:x1877767642721920:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779076.405782:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779076.405802:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d0f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42584b expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.405867:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d0fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.405909:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d0fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.405921:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d0fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779076.405972:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790779076.405976:0:13821:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779076.405995:0:13821:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d0fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.406037:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d0f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42584b expref: 31 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.406054:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d0fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42584b expref: 30 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.406062:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:2.0:1790779076.406065:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779076.406069:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3e00, rc 0) 00000100:00100000:2.0:1790779076.406129:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11276:x1877767642721920:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 373us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779076.406137:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:0.0:1790779076.419780:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779076.419955:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642722304 00000100:00100000:2.0:1790779076.420023:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642722304 00000100:00100000:2.0:1790779076.420124:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1790779076.420135:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11276:x1877767642722304:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779076.420556:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+31:11276:x1877767642722304:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 422us (785us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1790779076.420564:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1790779076.423717:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779076.423821:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642722432 00000100:00100000:1.0:1790779076.423831:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642722432 00000100:00100000:1.0:1790779076.423919:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:1.0:1790779076.423930:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+31:11276:x1877767642722432:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:1.0:1790779076.423947:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790779076.424083:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d08e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42582f expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.424106:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d0e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425844 expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.424119:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936cf84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257e9 expref: 29 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.424129:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:1.0:1790779076.424133:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779076.424441:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+28:11276:x1877767642722432:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 513us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779076.424450:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:0.0:1790779076.427985:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779076.428103:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642722560 00000100:00100000:1.0:1790779076.428113:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642722560 00000100:00100000:1.0:1790779076.428182:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:1.0:1790779076.428191:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+28:11276:x1877767642722560:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:1.0:1790779076.428537:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d105 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.428572:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d105 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.428585:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d105 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779076.428812:0:13003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779076.429115:0:13003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1790779076.429489:0:13003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1790779076.429589:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+28:11276:x1877767642722560:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 1395us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779076.429599:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:0.0:1790779076.467615:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779076.467752:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642722688 00000100:00100000:3.0:1790779076.467761:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642722688 00000100:00100000:3.0:1790779076.467861:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:3.0:1790779076.467872:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+28:11278:x1877767642722688:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779076.467928:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779076.467949:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d10c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425852 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468034:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d113 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468048:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d113 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468058:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d113 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468071:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d11a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468078:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d11a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468085:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d11a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468144:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468162:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468169:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779076.468211:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790779076.468215:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779076.468239:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468259:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468268:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d113 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468275:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d113 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468283:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d113 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468288:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779076.468292:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d113 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468299:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d113 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468311:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779076.468314:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779076.468318:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d113 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468325:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d113 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468339:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d11a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468344:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d11a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468355:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d11a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468360:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779076.468363:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d11a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468370:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d11a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468378:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7705528300) 00010000:00010000:3.0:1790779076.468381:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779076.468384:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d11a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468390:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d11a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468421:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d10c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425852 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468434:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425852 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.468441:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:3.0:1790779076.468443:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779076.468445:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662800, rc 0) 00000100:00100000:3.0:1790779076.468549:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11278:x1877767642722688:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 679us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779076.468563:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 77 00010000:00010000:3.0:1790779076.520307:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779077.225322:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779077.225346:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663778816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779077.225413:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779077.226781:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663778816 00000100:00100000:0.0:1790779077.226792:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663778816 00000100:00100000:0.0:1790779077.226847:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790779077.226857:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663778816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779077.226913:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1790779077.226982:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663778816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.226989:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790779077.227035:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663778816:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1790779077.302776:0:14213:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790779077.302786:0:14213:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790779077.302810:0:14213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790779077.302817:0:14213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1790779077.352740:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790779077.352748:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790779077.352782:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790779077.352790:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790779077.352939:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663778944:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790779077.353023:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81480 going to sleep for 11 seconds 00000100:00100000:3.0:1790779077.368664:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663778944:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790779077.372737:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779077.373500:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642722816 00000100:00100000:3.0:1790779077.373510:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642722816 00000100:00100000:3.0:1790779077.373578:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:3.0:1790779077.373589:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11290:x1877767642722816:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790779077.373620:0:6523:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790779077.374026:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11290:x1877767642722816:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 437us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779077.374035:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:3.0:1790779077.379096:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.384038:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642722944 00000100:00100000:1.0:1790779077.384052:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642722944 00000100:00100000:1.0:1790779077.384129:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:1.0:1790779077.384144:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11290:x1877767642722944:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790779077.384210:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d128 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384237:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d128 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384252:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d128 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384267:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d12f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384273:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d12f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384280:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d12f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384302:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d136 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384311:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384317:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779077.384364:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790779077.384368:0:10428:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779077.384381:0:10428:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384401:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d128 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384407:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d128 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384413:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d128 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384418:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cf400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779077.384422:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d128 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384430:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d128 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384442:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:1.0:1790779077.384445:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779077.384449:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d128 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384455:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d128 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384466:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d12f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384472:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d12f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384478:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d12f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384487:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779077.384490:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d12f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384496:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d12f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384503:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9b77156a9800) 00010000:00010000:1.0:1790779077.384506:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779077.384508:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d12f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384514:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d12f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384527:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384532:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d136 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384538:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384542:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cea00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779077.384556:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384562:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d136 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384578:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:1.0:1790779077.384581:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779077.384584:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d136 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.384590:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d136 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.384665:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11290:x1877767642722944:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 522us (5580us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779077.384673:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:1.0:1790779077.393069:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779077.393153:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642723200 00000100:00100000:2.0:1790779077.393163:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642723200 00000100:00100000:2.0:1790779077.393233:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:2.0:1790779077.393244:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11290:x1877767642723200:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779077.393265:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779077.393284:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d13d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425859 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393398:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d144 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393414:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393426:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779077.393437:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790779077.393509:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393518:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d144 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393525:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393531:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779077.393535:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393543:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d144 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393568:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:2.0:1790779077.393571:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779077.393576:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d144 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393593:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d144 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393636:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d13d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425859 expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393647:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:2.0:1790779077.393649:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779077.393653:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d13d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425859 expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.393662:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3a00, rc 0) 00000100:00100000:2.0:1790779077.393722:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11290:x1877767642723200:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 481us (661us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1790779077.393729:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:3.0:1790779077.401041:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779077.401242:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642723328 00000100:00100000:0.0:1790779077.401254:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642723328 00000100:00100000:0.0:1790779077.401314:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:0.0:1790779077.401324:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11290:x1877767642723328:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790779077.401359:0:6523:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790779077.401466:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11290:x1877767642723328:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 143us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.401474:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:0.0:1790779077.408092:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.408156:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642723584 00000100:00100000:1.0:1790779077.408166:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642723584 00000100:00100000:1.0:1790779077.408218:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:1.0:1790779077.408239:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11290:x1877767642723584:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779077.408260:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779077.408262:0:10428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790779077.408285:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d0fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42584b expref: 30 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.408302:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:1.0:1790779077.408306:0:10428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779077.408317:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d152 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425860 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790779077.408671:0:10428:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1790779077.408820:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d159 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.408835:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.408845:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.408930:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d152 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425860 expref: 32 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.408945:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425860 expref: 31 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.408953:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9800) 00010000:00010000:1.0:1790779077.408956:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779077.408958:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055ce400, rc 0) 00000100:00100000:1.0:1790779077.409018:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+31:11290:x1877767642723584:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 780us (934us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1790779077.409025:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:1.0:1790779077.414180:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779077.414273:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642723840 00000100:00100000:3.0:1790779077.414283:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642723840 00000100:00100000:3.0:1790779077.414352:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:3.0:1790779077.414368:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+31:11290:x1877767642723840:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790779077.414436:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779077.414471:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d159 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425860 expref: 31 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414494:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9800) 00010000:00010000:3.0:1790779077.414504:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779077.414535:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d167 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414579:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d167 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414589:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d167 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414613:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d16e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x24ccddbe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414620:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d16e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x24ccddbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414634:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d16e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x24ccddbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414681:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d167 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414695:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d167 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414703:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d167 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414709:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779077.414713:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d167 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414720:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d167 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414729:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779077.414737:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779077.414742:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d167 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414749:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d167 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414769:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d16e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x24ccddbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414774:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d16e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x24ccddbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414779:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d16e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x24ccddbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414784:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779077.414793:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d16e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x24ccddbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414799:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d16e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x24ccddbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414806:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x24ccddbe (ffff9b7705528300) 00010000:00010000:3.0:1790779077.414808:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779077.414811:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d16e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x24ccddbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.414816:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d16e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x24ccddbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779077.414954:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11290:x1877767642723840:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 592us (782us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790779077.414976:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:3.0:1790779077.417626:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.417703:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642723968 00000100:00100000:1.0:1790779077.417713:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642723968 00000100:00100000:1.0:1790779077.417773:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:1.0:1790779077.417783:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11290:x1877767642723968:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779077.417802:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779077.417823:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d175 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425867 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.417871:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d17c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.417906:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d17c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.417918:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d17c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.418016:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d175 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425867 expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.418033:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d17c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425867 expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.418041:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:1.0:1790779077.418043:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790779077.418047:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cf400, rc 0) 00000100:00100000:1.0:1790779077.418106:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+31:11290:x1877767642723968:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 326us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779077.418124:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:1.0:1790779077.424528:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779077.424654:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642724224 00000100:00100000:0.0:1790779077.424664:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642724224 00000100:00100000:0.0:1790779077.424723:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:0.0:1790779077.424732:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+31:11290:x1877767642724224:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790779077.424816:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.424834:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.424858:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790779077.425042:0:10428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1790779077.425051:0:10428:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395432171293ns, next at 396432169346ns, rc = 0 00000004:00010000:0.0:1790779077.425094:0:10428:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000085557332 reply state 000000006bfb4e7d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.425106:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.425129:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:0.0:1790779077.425132:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790779077.425136:0:10428:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790779077.425237:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+33:11290:x1877767642724224:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 505us (715us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1790779077.425245:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:3.0:1790779077.428788:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779077.430782:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642724352 00000100:00100000:0.0:1790779077.430795:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642724352 00000100:00100000:0.0:1790779077.430851:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 86 00000100:00100000:0.0:1790779077.430862:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+33:11290:x1877767642724352:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779077.430904:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779077.430924:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d18a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42586e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.430976:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d18a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42586e expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.431007:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d18a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42586e expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.431026:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:0.0:1790779077.431029:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790779077.431032:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769c00, rc 0) 00000100:00100000:0.0:1790779077.431088:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+34:11290:x1877767642724352:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 227us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.431095:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 86 00000100:00100000:3.0:1790779077.441340:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779077.441426:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642724480 00000100:00100000:0.0:1790779077.441435:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642724480 00000100:00100000:0.0:1790779077.441476:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:0.0:1790779077.441484:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1877767642724480:12345-192.168.203.3@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1790779077.441517:0:8855:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:0.0:1790779077.441553:0:8855:0:(genops.c:1384:class_connect()) connect: client e5203316-d1cf-49fe-9b64-c701aab9b690, cookie 0xb1aa4014e936d191 00002000:00100000:0.0:1790779077.441564:0:8855:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e5203316-d1cf-49fe-9b64-c701aab9b690/ffff9b773f618000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790779077.441580:0:8855:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790779077.441646:0:8855:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790779077.441672:0:8855:0:(import.c:65:import_set_state_nolock()) ffff9b773f619000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779077.441738:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2397:x1877767642724480:12345-192.168.203.3@tcp:8:lhsmtool_posix.0 Request processed in 253us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.441744:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:1.0:1790779077.454768:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779077.454875:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642724608 00000100:00100000:0.0:1790779077.454908:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642724608 00000100:00100000:0.0:1790779077.454987:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:0.0:1790779077.454996:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:0:x1877767642724608:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790779077.455343:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1790779077.459423:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:1.0:1790779077.459438:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000100:00100000:0.0:1790779077.459614:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:0:x1877767642724608:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 4613us (4848us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790779077.459627:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:2.0:1790779077.469063:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779077.469341:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642724864 00000100:00100000:3.0:1790779077.469352:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642724864 00000100:00100000:3.0:1790779077.469409:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1790779077.469419:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+34:11290:x1877767642724864:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790779077.469780:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+35:11290:x1877767642724864:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 361us (724us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1790779077.469789:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1790779077.494459:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779077.494961:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642725120 00000100:00100000:3.0:1790779077.494971:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642725120 00000100:00100000:3.0:1790779077.495028:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:3.0:1790779077.495038:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+35:11290:x1877767642725120:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790779077.495149:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+35:11290:x1877767642725120:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 104us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779077.495157:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:1.0:1790779077.498815:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.498860:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642725248 00000100:00100000:1.0:1790779077.498870:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642725248 00000100:00100000:1.0:1790779077.498996:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:1.0:1790779077.499009:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+35:11290:x1877767642725248:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779077.499046:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779077.499068:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d198 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425875 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.499194:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d19f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.499209:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.499230:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779077.499274:0:10428:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779077.499294:0:10428:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.499336:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d198 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425875 expref: 37 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.499353:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d19f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425875 expref: 36 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.499361:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:1.0:1790779077.499364:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790779077.499368:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cfc00, rc 0) 00000100:00100000:1.0:1790779077.499431:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+36:11290:x1877767642725248:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 426us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779077.499438:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:0.0:1790779077.513738:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779077.514008:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642725376 00000100:00100000:3.0:1790779077.514018:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642725376 00000100:00100000:3.0:1790779077.514068:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:3.0:1790779077.514078:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642725376:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779077.514096:0:8855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779077.514116:0:8855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d1a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42587c expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779077.514148:0:8855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd1ec5, blocks: 0x0 00010000:00010000:3.0:1790779077.514170:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1790779077.514175:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779077.514185:0:8855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42587c expref: 6 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.514205:0:8855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42587c expref: 6 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.514226:0:8855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662a00, rc 0) 00000100:00100000:3.0:1790779077.514280:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642725376:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 204us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779077.514287:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:1.0:1790779077.531090:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779077.531289:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642725632 00000100:00100000:0.0:1790779077.531299:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642725632 00000100:00100000:0.0:1790779077.531369:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:0.0:1790779077.531383:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+36:11290:x1877767642725632:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790779077.531533:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+36:11290:x1877767642725632:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 153us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.531541:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:0.0:1790779077.543543:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779077.543628:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642725760 00000100:00100000:2.0:1790779077.543638:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642725760 00000100:00100000:2.0:1790779077.543689:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:2.0:1790779077.543701:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:11290:x1877767642725760:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779077.543719:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779077.543739:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425883 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.543771:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d1a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42587c expref: 7 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.543796:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779077.543812:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779077.543820:0:8438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.543856:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42587c expref: 7 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.543871:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42587c expref: 7 pid: 8855 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779077.543912:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1877767663779072:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779077.544007:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c000 going to sleep for 11 seconds 00010000:00010000:2.0:1790779077.550399:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779077.559458:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1877767663779072:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779077.559496:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.559517:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2c00, rc 0) 00000100:00100000:1.0:1790779077.559590:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:11290:x1877767642725760:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 15891us (16055us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779077.559600:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:1.0:1790779077.560916:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.560946:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642725888 00000100:00100000:1.0:1790779077.560955:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642725888 00010000:00010000:1.0:1790779077.560993:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42587c expref: 7 pid: 8855 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.561026:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:1.0:1790779077.561036:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642725888:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779077.561052:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779077.561073:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42587c expref: 7 pid: 8855 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.561087:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42587c expref: 7 pid: 8855 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.561128:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d1a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42587c expref: 7 pid: 8855 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.561143:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779077.561148:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779077.561156:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.561166:0:6510:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.561206:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.561230:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6510:1877767663779200:192.168.203.3@tcp:105: 00000100:00100000:1.0:1790779077.561296:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779077.574735:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779077.575311:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6510:1877767663779200:192.168.203.3@tcp:105: 00010000:00010000:3.0:1790779077.575332:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779077.575383:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642725888:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 14348us (14472us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779077.575394:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:2.0:1790779077.577770:0:8445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642726016 00000100:00100000:2.0:1790779077.577783:0:8445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642726016 00002000:00100000:2.0:1790779077.577829:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9b77108a5880 x1877767642726016/t0(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:628/0 lens 504/0 e 0 to 0 dl 1790779088 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779077.577840:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b77108a5880 with x1877767642726016 ext(0->8) 00002000:00010000:2.0:1790779077.577845:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b77108a5880 00000100:00100000:2.0:1790779077.577899:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:2.0:1790779077.577908:0:8445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642726016:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790779077.579768:0:8445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2400:x1877767642726016:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 1854us (5032us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790779077.579791:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00002000:00100000:2.0:1790779077.579800:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9b77108a5880 x1877767642726016/t4294967303(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:628/0 lens 504/448 e 0 to 0 dl 1790779088 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779077.579810:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b77108a5880 with x1877767642726016 ext(0->8) 00002000:00010000:2.0:1790779077.579815:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b77108a5880 00000100:00100000:3.0:1790779077.584424:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.584551:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642726144 00000100:00100000:1.0:1790779077.584560:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642726144 00000100:00100000:1.0:1790779077.584614:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:1.0:1790779077.584624:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+36:11290:x1877767642726144:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1790779077.589277:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589294:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589318:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589324:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779077.589329:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589336:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589350:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:3.0:1790779077.589353:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779077.589358:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589364:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d03a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589384:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589391:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589397:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589402:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779077.589405:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589423:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589432:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:3.0:1790779077.589435:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779077.589438:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589445:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d080 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589457:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589463:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589469:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589474:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779077.589476:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589482:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589489:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:3.0:1790779077.589492:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790779077.589495:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.589510:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d183 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779077.589554:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1790779077.589568:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1790779077.589615:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1790779077.589651:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1790779077.589662:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1790779077.589851:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779077.589870:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663779328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790779077.589959:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779077.589999:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663779328 00000100:00100000:2.0:1790779077.590008:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663779328 00000100:00100000:2.0:1790779077.590079:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790779077.590092:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663779328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790779077.590232:0:8855:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790779077.590236:0:8855:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790779077 00002000:00010000:2.0:1790779077.590238:0:8855:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790779077.590240:0:8855:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790779077 -> 1790779077 00002000:00010000:2.0:1790779077.590243:0:8855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1790779077.590294:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663779328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (334us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790779077.590302:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1790779077.590423:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1790779077.590446:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603843b80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1790779077.590454:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663779328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790779077.590461:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+14:11290:x1877767642726144:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 5834us (6043us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.590475:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:1.0:1790779077.592759:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779077.592849:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642726272 00000100:00100000:0.0:1790779077.592859:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642726272 00000100:00100000:1.0:1790779077.594758:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:1.0:1790779077.594775:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642726272:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1790779077.599617:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1790779077.599632:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1790779077.600682:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642726272:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 5906us (7924us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779077.600694:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:3.0:1790779077.609631:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.610390:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642726528 00000100:00100000:1.0:1790779077.610401:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642726528 00000100:00100000:1.0:1790779077.610463:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:1.0:1790779077.610473:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+14:11290:x1877767642726528:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790779077.610528:0:10428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779077.610555:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d19f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425875 expref: 14 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.610572:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:1.0:1790779077.610577:0:10428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779077.610605:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.610618:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.610628:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790779077.610817:0:10428:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005db9f839 reply state 0000000039037b3d transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.610848:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.610854:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:1.0:1790779077.610857:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779077.610859:0:10428:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779077.611194:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+15:11290:x1877767642726528:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 721us (1572us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1790779077.611202:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:3.0:1790779077.614406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.617852:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642726656 00000100:00100000:1.0:1790779077.617865:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642726656 00000100:00100000:1.0:1790779077.617931:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:1.0:1790779077.617938:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642726656:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790779077.618107:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1790779077.618110:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790779077 -> 1790779075 00002000:00010000:1.0:1790779077.618112:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790779073 00002000:00010000:1.0:1790779077.618113:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790779077 -> 1790779075 00002000:00010000:1.0:1790779077.618115:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1790779077.618178:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2401:x1877767642726656:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 240us (3781us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790779077.618184:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:2.0:1790779077.622992:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.623171:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642726912 00000100:00100000:1.0:1790779077.623181:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642726912 00000100:00100000:1.0:1790779077.623339:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:1.0:1790779077.623350:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+15:11290:x1877767642726912:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790779077.623416:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.623447:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d17c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425867 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.623457:0:6524:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.623491:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d17c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425867 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.623504:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d17c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425867 expref: 15 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.623516:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1877767663779456:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779077.623608:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d819c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779077.627967:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779077.628050:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642727040 00000100:00100000:0.0:1790779077.628059:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642727040 00010000:00010000:0.0:1790779077.628095:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d17c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425867 expref: 16 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779077.628135:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:0.0:1790779077.628159:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+16:2401:x1877767642727040:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779077.628172:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779077.628178:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d17c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425867 expref: 16 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.628199:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d17c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425867 expref: 16 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.628227:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:0.0:1790779077.628233:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.628243:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.628251:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.628278:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779077.628328:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+16:2401:x1877767642727040:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 170us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.628335:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00010000:00010000:1.0:1790779077.629825:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d17c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425867 expref: 15 pid: 6523 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.629847:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1877767663779456:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779077.629867:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.629877:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.630067:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.630102:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.630125:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.630132:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.630344:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cfc00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779077.630349:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.630357:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.630370:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:1.0:1790779077.630372:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790779077.630377:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.630383:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1bb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.630505:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+14:11290:x1877767642726912:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 7155us (7521us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790779077.630515:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:2.0:1790779077.645064:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.645705:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642727168 00000100:00100000:1.0:1790779077.645715:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642727168 00000100:00100000:1.0:1790779077.645978:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:1.0:1790779077.646091:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642727168:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790779077.646148:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.646181:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.646197:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779077.646201:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779077.646205:0:8438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.646263:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.646278:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 7 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.646292:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1877767663779584:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779077.646376:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779077.651591:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1877767663779584:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779077.651619:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779077.660817:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.661643:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642727296 00000100:00100000:1.0:1790779077.661653:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642727296 00010000:00010000:1.0:1790779077.661696:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 8 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.661754:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1790779077.661764:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2400:x1877767642727296:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779077.661779:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779077.661800:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 8 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.661813:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 8 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.661835:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936d1ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425883 expref: 8 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.661852:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779077.661857:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779077.661862:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.661872:0:6509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.661944:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779077.661995:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642727296:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 232us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779077.662002:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00010000:00010000:0.0:1790779077.662080:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.662090:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.662109:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.662125:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.662132:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.662150:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cf400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779077.662155:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.662165:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.662178:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.662185:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fc937b5/0xb1aa4014e936d1c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779077.662265:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642727168:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 16268us (17200us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.662273:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:2.0:1790779077.670751:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.670840:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642727552 00000100:00100000:1.0:1790779077.670850:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642727552 00000100:00100000:1.0:1790779077.670927:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 93 00000100:00100000:1.0:1790779077.670937:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+14:11290:x1877767642727552:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790779077.671012:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.671030:0:13821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d009 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42580c expref: 14 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.671039:0:13821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.671071:0:13821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d009 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42580c expref: 14 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.671085:0:13821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d009 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42580c expref: 14 pid: 10428 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.671098:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663779712:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779077.671193:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d819c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779077.673959:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779077.674038:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642727680 00000100:00100000:0.0:1790779077.674047:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642727680 00010000:00010000:0.0:1790779077.674087:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d009 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42580c expref: 15 pid: 10428 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779077.674148:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:0.0:1790779077.674158:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+15:2400:x1877767642727680:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779077.674173:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779077.674180:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d009 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42580c expref: 15 pid: 10428 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.674201:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d009 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42580c expref: 15 pid: 10428 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.674230:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:0.0:1790779077.674235:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.674245:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.674253:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.674273:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779077.674331:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+15:2400:x1877767642727680:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 174us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.674339:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00010000:00010000:1.0:1790779077.675282:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d009 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42580c expref: 14 pid: 10428 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.675303:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663779712:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779077.675324:0:13821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.675346:0:13821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.675352:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.677465:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.677498:0:13821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d18a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42586e expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.677509:0:13821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.677793:0:13821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d18a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42586e expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779077.677811:0:13821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d18a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42586e expref: 14 pid: 6525 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779077.677826:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663779840:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779077.677950:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773426d300 going to sleep for 11 seconds 00000100:00100000:0.0:1790779077.688404:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663779840:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779077.688436:0:13821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779077.692267:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779077.696425:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642727808 00000100:00100000:1.0:1790779077.696442:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642727808 00010000:00010000:0.0:1790779077.696582:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d18a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42586e expref: 15 pid: 6525 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779077.696632:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:0.0:1790779077.696642:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+15:2401:x1877767642727808:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779077.696657:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779077.696664:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d18a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42586e expref: 15 pid: 6525 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.696678:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d18a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42586e expref: 15 pid: 6525 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.696700:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d18a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42586e expref: 15 pid: 6525 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.696716:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:0.0:1790779077.696721:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.696730:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.696738:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.696768:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779077.696826:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+14:2401:x1877767642727808:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 186us (4581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.696846:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00010000:00010000:1.0:1790779077.696912:0:13821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.696921:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779077.697022:0:13821:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1790779077.697116:0:13821:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1790779077.697160:0:13821:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1790779077.697242:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13821:1877767663779968:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1790779077.697292:0:13821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779077.697316:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779077.698362:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663779968 00000100:00100000:0.0:1790779077.698370:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663779968 00000100:00100000:0.0:1790779077.698414:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790779077.698422:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13821:x1877767663779968:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1790779077.698513:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13821:x1877767663779968:12345-0@lo:1000:mdt00_005.0 Request processed in 91us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.698520:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790779077.698751:0:13821:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1790779077.698769:0:13821:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603843b80, transno 4294967304 00000100:00100000:1.0:1790779077.698790:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13821:1877767663779968:0@lo:1000:mdt00_005.0 00000001:00080000:1.0:1790779077.698949:0:13821:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1790779077.699008:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13821:1877767663780096:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1790779077.699052:0:13821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779077.699072:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779077.699750:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663780096 00000100:00100000:0.0:1790779077.699757:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663780096 00000100:00100000:0.0:1790779077.699802:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790779077.699810:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13821:x1877767663780096:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1790779077.699971:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13821:x1877767663780096:12345-0@lo:1000:mdt00_005.0 Request processed in 162us (918us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790779077.699978:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790779077.700092:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13821:1877767663780096:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1790779077.700128:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700148:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700155:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700161:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cea00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779077.700165:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700173:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700300:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:1.0:1790779077.700304:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779077.700310:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700317:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d1d0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700360:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d105 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700367:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d105 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700372:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d105 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700376:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779077.700379:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d105 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700385:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d105 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700392:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:1.0:1790779077.700395:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779077.700397:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d105 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700403:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d105 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700423:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700436:0:13821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425852 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700445:0:13821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700478:0:13821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425852 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.700490:0:13821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425852 expref: 17 pid: 6524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.700503:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f509180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663780224:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779077.700679:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77154f13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779077.707849:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779077.707936:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642727936 00000100:00100000:0.0:1790779077.707945:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642727936 00010000:00010000:0.0:1790779077.707983:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425852 expref: 18 pid: 6524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779077.708018:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:0.0:1790779077.708026:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+18:2400:x1877767642727936:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779077.708039:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779077.708046:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425852 expref: 18 pid: 6524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.708075:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425852 expref: 18 pid: 6524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.708095:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:0.0:1790779077.708099:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.708108:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.708115:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.708131:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779077.708195:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+18:2400:x1877767642727936:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 169us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.708202:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00010000:00010000:1.0:1790779077.708346:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d121 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425852 expref: 17 pid: 6524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.708362:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f509180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663780224:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779077.708386:0:13821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708394:0:13821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708400:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708411:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708418:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708424:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708437:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cf400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779077.708442:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708450:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708459:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:1.0:1790779077.708462:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779077.708465:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708471:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d1d7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708481:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708487:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708492:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708497:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cfc00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779077.708500:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708506:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708525:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b77156a9f00) 00010000:00010000:1.0:1790779077.708527:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790779077.708530:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779077.708536:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d1c9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779077.708677:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+16:11290:x1877767642727552:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 37742us (37935us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1790779077.708685:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 93 00000020:00080000:1.0:1790779077.708689:0:13821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790779077.708918:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790779077.708923:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790779077.708939:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790779077.708947:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790779077.711345:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779077.711428:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642728192 00000100:00100000:0.0:1790779077.711437:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642728192 00000100:00100000:0.0:1790779077.711491:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:0.0:1790779077.711500:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+16:11290:x1877767642728192:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790779077.711754:0:6527:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790779077.711788:0:6527:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1790779077.711820:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d1de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.711837:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d1de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.711866:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d1de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.711875:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d1de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.711921:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d1de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.711927:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d1de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779077.711940:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790779077.712031:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+18:11290:x1877767642728192:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 531us (693us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1790779077.712038:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000020:00080000:0.0:1790779077.712042:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790779077.712166:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779077.712173:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d1de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.712181:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779077.712184:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d1de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.712192:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d1de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.712203:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:2.0:1790779077.712206:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790779077.712210:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d1de lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.712215:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d1de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779077.712237:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779077.712239:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779077.712241:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779077.811705:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779077.811746:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779077.811781:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779077.811902:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642728448 00000100:00100000:2.0:1790779077.811912:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642728448 00000100:00100000:2.0:1790779077.811971:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642728704 00000100:00100000:2.0:1790779077.811974:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642728704 00000100:00100000:3.0:1790779077.811995:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779077.812001:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00100000:2.0:1790779077.812011:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642728448:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779077.812020:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00080000:3.0:1790779077.812052:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790779077.812056:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790779077.812066:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642728576 00000100:00100000:3.0:1790779077.812069:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642728576 00000100:00100000:2.0:1790779077.812081:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642728448:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 71us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779077.812097:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 108 00000100:00100000:2.0:1790779077.812098:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00100000:3.0:1790779077.812105:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2401:x1877767642728576:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779077.812113:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642728832 00000100:00100000:2.0:1790779077.812116:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642728832 00000100:00100000:3.0:1790779077.812131:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2401:x1877767642728576:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779077.812137:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 108 00000100:00080000:3.0:1790779077.812151:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779077.812152:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 282 00000100:00080000:3.0:1790779077.812154:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779077.812158:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642728704:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779077.812163:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 283 00000100:00100000:3.0:1790779077.812169:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642728832:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779077.812190:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642728832:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779077.812195:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642728704:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 38us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779077.812197:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 283 00000100:00100000:2.0:1790779077.812201:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 282 00000100:00100000:0.0:1790779077.816237:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642728320 00000100:00100000:0.0:1790779077.816252:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642728320 00000100:00100000:0.0:1790779077.816388:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 381 00000100:00100000:0.0:1790779077.816398:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7703020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642728320:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779077.816528:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7703020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642728320:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 131us (4745us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779077.816551:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 381 00010000:00010000:1.0:1790779078.569768:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779078.767795:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790779078.767823:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663780352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779078.767915:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779078.768008:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663780352 00000100:00100000:0.0:1790779078.768030:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663780352 00000100:00100000:3.0:1790779078.768372:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779078.768383:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663780480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779078.768417:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779078.768493:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663780480 00000100:00100000:3.0:1790779078.768497:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663780480 00000100:00100000:0.0:1790779078.768531:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790779078.768542:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663780352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779078.768570:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1790779078.768619:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663780352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779078.769030:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663780352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779078.778677:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790779078.778696:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663780480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790779078.778725:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1790779078.778806:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663780480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (10389us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779078.778814:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1790779078.778860:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779078.778941:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663780480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779078.781135:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000040:00080000:2.0:1790779079.374933:0:14264:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790779079.374942:0:14264:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790779079.375075:0:14264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790779079.375083:0:14264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790779079.598695:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779079.638736:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779079.640043:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642729088 00000100:00100000:3.0:1790779079.640056:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642729088 00000100:00100000:3.0:1790779079.640140:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 94 00000100:00100000:3.0:1790779079.640152:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+18:11308:x1877767642729088:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779079.640188:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779079.640219:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d1e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42588a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.640322:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d1ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.640337:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d1ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.640348:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d1ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779079.640359:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1790779079.640459:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d1e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42588a expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.640474:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d1ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42588a expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.640482:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779079.640485:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790779079.640487:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663200, rc 0) 00000100:00100000:3.0:1790779079.640549:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+20:11308:x1877767642729088:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 401us (1826us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1790779079.640556:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 94 00000100:00080000:1.0:1790779079.641111:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779079.643535:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779079.643680:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642729216 00000100:00100000:3.0:1790779079.643689:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642729216 00000100:00100000:3.0:1790779079.643747:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:3.0:1790779079.643758:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+20:11308:x1877767642729216:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:3.0:1790779079.643829:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d1fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.643847:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d1fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.643860:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d1fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.643875:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d201 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.643919:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.643927:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644000:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d208 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644009:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644017:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779079.644072:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644086:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d1fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644093:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d1fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644101:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d1fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644107:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779079.644111:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d1fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644119:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d1fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644141:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779079.644144:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779079.644149:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d1fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644155:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d1fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644166:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644171:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d201 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644323:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644328:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779079.644332:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644339:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d201 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644348:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7705528100) 00010000:00010000:3.0:1790779079.644350:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779079.644353:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d201 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644358:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d201 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644374:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644380:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d208 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644385:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644389:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779079.644391:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644407:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d208 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644415:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7705528400) 00010000:00010000:3.0:1790779079.644417:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779079.644420:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d208 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.644425:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d208 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779079.644506:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+20:11308:x1877767642729216:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 749us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.644514:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:2.0:1790779079.722151:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779079.722213:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642729472 00000100:00100000:0.0:1790779079.722224:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642729472 00000100:00100000:0.0:1790779079.722292:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:0.0:1790779079.722302:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+20:11311:x1877767642729472:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1790779079.722325:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779079.722347:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d20f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425891 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722430:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d216 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722446:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d216 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722458:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d216 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722472:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936d21d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722477:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936d21d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722504:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936d21d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722622:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d224 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722631:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722638:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779079.722647:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790779079.722742:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d216 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722751:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d216 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722758:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d216 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722764:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779079.722768:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d216 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722776:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d216 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722788:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:0.0:1790779079.722791:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779079.722803:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d216 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722810:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d216 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722823:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936d21d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722829:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936d21d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722835:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936d21d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722840:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779079.722842:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936d21d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722847:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936d21d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722854:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7603616b00) 00010000:00010000:0.0:1790779079.722856:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779079.722858:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936d21d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722863:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769a00/0xb1aa4014e936d21d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722922:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d20f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425891 expref: 23 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722949:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425891 expref: 22 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.722956:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:0.0:1790779079.723027:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790779079.723030:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768800, rc 0) 00000100:00100000:0.0:1790779079.723095:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11311:x1877767642729472:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 795us (963us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1790779079.723103:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:1.0:1790779079.733165:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779079.733264:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642729600 00000100:00100000:3.0:1790779079.733274:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642729600 00000100:00100000:3.0:1790779079.733329:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:3.0:1790779079.733339:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11311:x1877767642729600:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:3.0:1790779079.733409:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d232 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.733426:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.733438:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.733473:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.733497:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d232 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.733503:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d232 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.733509:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779079.733514:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d232 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.733522:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d232 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.733534:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:3.0:1790779079.733537:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790779079.733542:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d232 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.733548:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d232 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779079.733621:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11311:x1877767642729600:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 283us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.733629:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:1.0:1790779079.742034:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779079.742189:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642729856 00000100:00100000:0.0:1790779079.742200:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642729856 00000100:00100000:0.0:1790779079.742271:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:0.0:1790779079.742282:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718265850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11311:x1877767642729856:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1790779079.742506:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718265850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+23:11311:x1877767642729856:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 225us (480us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1790779079.742514:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1790779079.784243:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663780864:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.784324:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.784400:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663781376:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.784433:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.784453:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663781888:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.784487:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.784522:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663782400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779079.784549:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.784573:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790779079.784580:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663780992:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.784605:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.784620:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663781504:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.784630:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663780608:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.784642:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.784666:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663782016:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.784673:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.784695:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779079.784706:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663781120:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.784733:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663782400 00000100:00100000:1.0:1790779079.784739:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.784741:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663782400 00000100:00100000:1.0:1790779079.784761:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663781760:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.784787:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.784804:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790779079.784811:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663782144:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.784818:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663782400:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779079.784836:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1790779079.784848:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779079.784869:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1790779079.784897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663780736:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.784918:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663782400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779079.784927:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.784931:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790779079.784951:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663781248:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.784960:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663781504 00000100:00100000:3.0:1790779079.784965:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663781504 00000100:00100000:1.0:1790779079.784975:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.784995:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663781760 00000100:00100000:1.0:1790779079.784997:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663781632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779079.784999:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663781760 00000100:00100000:3.0:1790779079.785021:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663782144 00000100:00100000:3.0:1790779079.785025:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663782144 00000100:00100000:1.0:1790779079.785030:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.785044:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790779079.785051:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663782272:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.785054:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663781504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.785078:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779079.785102:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663781504:12345-0@lo:400:kworker.0 Request processed in 51us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.785116:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790779079.785128:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663781376 00000100:00100000:3.0:1790779079.785132:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663782272 00000100:00100000:1.0:1790779079.785134:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663781376 00000100:00100000:3.0:1790779079.785139:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663782272 00000100:00100000:3.0:1790779079.785162:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790779079.785168:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663781760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.785219:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663781760:12345-0@lo:400:kworker.0 Request processed in 36us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.785225:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790779079.785237:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790779079.785244:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663782144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.785271:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663782144:12345-0@lo:400:kworker.0 Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.785276:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790779079.785286:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790779079.785291:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1877767663782272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.785318:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1877767663782272:12345-0@lo:400:kworker.0 Request processed in 27us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.785324:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790779079.785341:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663781632 00000100:00100000:3.0:1790779079.785345:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663781632 00000100:00100000:3.0:1790779079.785365:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790779079.785371:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1877767663781632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790779079.785382:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779079.785408:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1877767663781632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.785423:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790779079.785462:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663781504:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.785479:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663782400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779079.785511:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663781888 00000100:00100000:3.0:1790779079.785515:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663781888 00000100:00100000:3.0:1790779079.785535:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663780992 00000100:00100000:3.0:1790779079.785538:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663780992 00000100:00100000:1.0:1790779079.785545:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663782016 00000100:00100000:1.0:1790779079.785552:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663782016 00000100:00100000:3.0:1790779079.785553:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663780736 00000100:00100000:3.0:1790779079.785558:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663780736 00000100:00100000:1.0:1790779079.785580:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663781248 00000100:00100000:3.0:1790779079.785585:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1790779079.785585:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663781248 00000100:00100000:3.0:1790779079.785596:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663781376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.785612:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1790779079.785624:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663781888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.785640:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663781376:12345-0@lo:400:kworker.0 Request processed in 45us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.785648:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790779079.785665:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1790779079.785670:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663781888:12345-0@lo:400:kworker.0 Request processed in 48us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.785676:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663780992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.785682:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1790779079.785700:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790779079.785709:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663782016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.785717:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663780992:12345-0@lo:400:kworker.0 Request processed in 45us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.785724:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1790779079.785741:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1790779079.785746:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663782016:12345-0@lo:400:kworker.0 Request processed in 38us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.785751:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663780736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.785757:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790779079.785772:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1790779079.785780:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663781248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.785802:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663780736:12345-0@lo:400:kworker.0 Request processed in 54us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.785811:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1790779079.785828:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663781248:12345-0@lo:400:kworker.0 Request processed in 47us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779079.785836:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1790779079.785844:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663780992:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.785863:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663780608 00000100:00100000:1.0:1790779079.785868:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663780608 00010000:00080000:3.0:1790779079.785869:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4ec380 x1877767663782016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779079.785909:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663782016:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.785921:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00010000:00080000:3.0:1790779079.785926:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a3e680 x1877767663781376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779079.785933:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663780608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.785942:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663781376:0@lo:400:kworker.0 00000100:00100000:3.0:1790779079.785955:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663781888:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.785978:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663780608:12345-0@lo:400:kworker.0 Request processed in 47us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779079.785985:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1790779079.786019:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663780864 00000100:00100000:1.0:1790779079.786023:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663780864 00000100:00100000:1.0:1790779079.786039:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663781120 00000100:00100000:1.0:1790779079.786041:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663781120 00000100:00100000:1.0:1790779079.786052:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790779079.786058:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663780864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.786101:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663780864:12345-0@lo:400:kworker.0 Request processed in 42us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779079.786107:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790779079.786118:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790779079.786124:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663781120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.786152:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663781120:12345-0@lo:400:kworker.0 Request processed in 28us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779079.786158:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1790779079.787385:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790779079.787396:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790779079.787400:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790779079.787416:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779079.787564:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663780864:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.788464:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663780736:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.788478:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663781248:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.788497:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663781632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790779079.788506:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663782272:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.788516:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663780608:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.788527:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663781120:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.788539:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663781760:0@lo:400:kworker.0 00000100:00100000:1.0:1790779079.788550:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663782144:0@lo:400:kworker.0 00000001:00080000:1.0:1790779079.796654:0:9517:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1790779079.796671:0:9517:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1790779079.826241:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779079.827037:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642730112 00000100:00100000:3.0:1790779079.827049:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642730112 00000100:00100000:3.0:1790779079.827117:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00100000:3.0:1790779079.827193:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+23:10826:x1877767642730112:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779079.827229:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779079.827249:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d239 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425898 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.827512:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.827529:0:10428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d224 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425891 expref: 24 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.827539:0:10428:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.827589:0:10428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425891 expref: 24 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.827604:0:10428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d224 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425891 expref: 24 pid: 10428 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779079.827618:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663782528:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779079.827727:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760345bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790779079.833236:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663782528:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779079.833276:0:10428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779079.835499:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779079.836348:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642730240 00000100:00100000:0.0:1790779079.836359:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642730240 00010000:00010000:0.0:1790779079.836433:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d224 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425891 expref: 25 pid: 10428 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779079.836473:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:0.0:1790779079.836483:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+25:2401:x1877767642730240:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779079.836497:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779079.836505:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d224 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425891 expref: 25 pid: 10428 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.836533:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425891 expref: 25 pid: 10428 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.836555:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d224 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425891 expref: 25 pid: 10428 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.836570:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:0.0:1790779079.836575:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.836584:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.836591:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.836630:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779079.836681:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+24:2401:x1877767642730240:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 200us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779079.836688:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00010000:00010000:1.0:1790779079.837283:0:10428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779079.837294:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779079.837315:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1790779079.837447:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d239 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425898 expref: 25 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779079.837466:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425898 expref: 24 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779079.837474:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:1.0:1790779079.837485:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790779079.837488:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663000, rc 0) 00000100:00100000:1.0:1790779079.837536:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+24:10826:x1877767642730112:12345-192.168.203.3@tcp:101:bash.0 Request processed in 10347us (11304us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1790779079.837543:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00100000:2.0:1790779079.859490:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779079.859681:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642730368 00000100:00100000:3.0:1790779079.859691:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642730368 00000100:00100000:3.0:1790779079.859754:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:3.0:1790779079.859764:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+24:10826:x1877767642730368:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779079.859792:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779079.859813:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d24e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42589f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.859845:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d255 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.859859:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d255 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.859869:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d255 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.860018:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d24e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42589f expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.860036:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d255 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42589f expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779079.860046:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:3.0:1790779079.860049:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790779079.860052:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663800, rc 0) 00000100:00100000:3.0:1790779079.860103:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+25:10826:x1877767642730368:12345-192.168.203.3@tcp:101:bash.0 Request processed in 340us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779079.860110:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:0.0:1790779079.863872:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779079.864100:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642730624 00000100:00100000:1.0:1790779079.864110:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642730624 00000100:00100000:1.0:1790779079.864178:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 100 00000100:00100000:1.0:1790779079.864188:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+25:10826:x1877767642730624:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:1.0:1790779079.864416:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779079.864437:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779079.864450:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779079.864494:0:13003:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1790779079.864514:0:13003:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c840ccbb reply state 00000000167a030f transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779079.864525:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779079.864533:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:1.0:1790779079.864536:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779079.864539:0:13003:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790779079.864571:0:13003:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1790779079.864665:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+29:10826:x1877767642730624:12345-192.168.203.3@tcp:36:bash.0 Request processed in 477us (800us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1790779079.864686:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 100 00000020:00080000:1.0:1790779079.864692:0:13003:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1790779079.866613:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779079.866737:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642730752 00000100:00100000:1.0:1790779079.866746:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642730752 00000100:00100000:1.0:1790779079.866804:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 101 00000100:00100000:1.0:1790779079.866814:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+29:10826:x1877767642730752:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1790779079.866835:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779079.866851:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d263 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258a6 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779079.866929:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d263 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258a6 expref: 30 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779079.866944:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d263 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258a6 expref: 30 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779079.868259:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:1.0:1790779079.868263:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779079.868267:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77055cf400, rc 0) 00000100:00100000:1.0:1790779079.868333:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+30:10826:x1877767642730752:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1517us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779079.868342:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 101 00000100:00100000:3.0:1790779079.874728:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779079.874913:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642730880 00000100:00100000:0.0:1790779079.874924:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642730880 00000100:00100000:0.0:1790779079.875010:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:0.0:1790779079.875021:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:10826:x1877767642730880:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1790779079.875040:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779079.875077:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f1b44bc/0xb1aa4014e936d26a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258ad expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779079.875105:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6abd1ec3, atime: 0x6abd1ec1, ctime: 0x6abd1ec3, blocks: 0x8 00010000:00010000:0.0:1790779079.875129:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:0.0:1790779079.875133:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779079.875152:0:8439:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f1b44bc/0xb1aa4014e936d26a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ad expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.875170:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f1b44bc/0xb1aa4014e936d26a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ad expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779079.875181:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768a00, rc 0) 00000100:00100000:0.0:1790779079.875256:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:10826:x1877767642730880:12345-192.168.203.3@tcp:101:bash.0 Request processed in 238us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779079.875263:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00080000:1.0:1790779079.875441:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779079.879484:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779079.880259:0:8443:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642731008 00000100:00100000:2.0:1790779079.880270:0:8443:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642731008 00002000:00010000:2.0:1790779079.880312:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1790779079.880317:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773f51fb80 with x1877767642731008 ext(0->18446744073709551615) 00002000:00010000:2.0:1790779079.880328:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773f51fb80. 00000100:00100000:2.0:1790779079.880361:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:2.0:1790779079.880371:0:8443:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642731008:12345-192.168.203.3@tcp:10:bash.0 00002000:00010000:2.0:1790779079.880629:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790779079.880642:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790779075 -> 1790779079 00002000:00010000:2.0:1790779079.880645:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1790779073 -> 1790779073 00002000:00010000:2.0:1790779079.880647:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790779075 -> 1790779079 00002000:00010000:2.0:1790779079.880649:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1790779079.880714:0:8443:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2400:x1877767642731008:12345-192.168.203.3@tcp:10:bash.0 Request processed in 345us (1238us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790779079.880722:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00002000:00010000:2.0:1790779079.880726:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1790779079.880729:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773f51fb80 with x1877767642731008 ext(0->18446744073709551615) 00002000:00010000:2.0:1790779079.880734:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773f51fb80. 00000100:00100000:2.0:1790779080.026592:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.026679:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642731136 00000100:00100000:3.0:1790779080.026689:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642731136 00000100:00100000:3.0:1790779080.026748:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 102 00000100:00100000:3.0:1790779080.026758:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11325:x1877767642731136:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:3.0:1790779080.026831:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d271 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.026849:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d271 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.026861:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d271 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.026905:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d278 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.026928:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.026935:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027012:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d27f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027021:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027028:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779080.027073:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027085:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d271 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027091:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d271 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027098:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d271 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027104:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779080.027107:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d271 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027114:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d271 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027132:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779080.027135:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779080.027140:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d271 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027147:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d271 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027160:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027166:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d278 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027354:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027360:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779080.027363:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027369:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d278 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027378:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7705528400) 00010000:00010000:3.0:1790779080.027381:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779080.027384:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d278 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027390:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d278 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027418:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027425:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d27f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027430:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d27f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027436:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779080.027439:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d27f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027445:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d27f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027454:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:3.0:1790779080.027456:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779080.027460:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d27f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.027466:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d27f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779080.029255:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11325:x1877767642731136:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 2411us (2585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779080.029272:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 102 00000100:00100000:3.0:1790779080.127236:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779080.127305:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642731392 00000100:00100000:1.0:1790779080.127316:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642731392 00000100:00100000:1.0:1790779080.127378:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:1.0:1790779080.127389:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11328:x1877767642731392:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779080.127424:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779080.127445:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d286 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258b4 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127524:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d28d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127539:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d28d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127550:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d28d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127565:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d294 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127572:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127578:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127722:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d29b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127732:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127739:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779080.127750:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790779080.127837:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d28d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127845:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d28d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127852:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d28d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127859:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779080.127864:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d28d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127871:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d28d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127917:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:1.0:1790779080.127921:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779080.127927:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d28d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127933:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce600/0xb1aa4014e936d28d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127960:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127967:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d294 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127973:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127988:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779080.127992:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.127999:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d294 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.128008:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b771d81af00) 00010000:00010000:1.0:1790779080.128010:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779080.128013:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d294 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.128020:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce800/0xb1aa4014e936d294 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.128073:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cea00/0xb1aa4014e936d286 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258b4 expref: 33 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.128087:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d29b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258b4 expref: 32 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.128095:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:1.0:1790779080.128097:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790779080.128100:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7200, rc 0) 00000100:00100000:1.0:1790779080.128166:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+32:11328:x1877767642731392:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 778us (947us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1790779080.128174:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:1.0:1790779080.138006:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.138103:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642731520 00000100:00100000:3.0:1790779080.138113:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642731520 00000100:00100000:3.0:1790779080.138186:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00100000:3.0:1790779080.138196:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+32:11328:x1877767642731520:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:3.0:1790779080.138284:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.138302:0:10428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425898 expref: 32 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.138312:0:10428:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.138345:0:10428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425898 expref: 32 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.138360:0:10428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425898 expref: 32 pid: 10428 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779080.138374:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663782656:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779080.138492:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760345bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790779080.149661:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663782656:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779080.149691:0:10428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779080.150926:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.151209:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642731776 00000100:00100000:3.0:1790779080.151219:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642731776 00000100:00100000:3.0:1790779080.151281:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1790779080.151289:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+33:6168:x1877767642731776:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790779080.151784:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+34:6168:x1877767642731776:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 494us (863us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1790779080.151807:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1790779080.171867:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779080.171978:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642731904 00000100:00100000:0.0:1790779080.171996:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642731904 00010000:00010000:0.0:1790779080.172037:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425898 expref: 34 pid: 10428 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779080.172083:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:0.0:1790779080.172096:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+34:2400:x1877767642731904:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779080.172110:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779080.172116:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425898 expref: 34 pid: 10428 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.172155:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425898 expref: 34 pid: 10428 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.172177:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d240 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425898 expref: 34 pid: 10428 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.172192:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:0.0:1790779080.172197:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.172217:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.172224:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.172253:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779080.172311:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+33:2400:x1877767642731904:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 217us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779080.172318:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00010000:00010000:3.0:1790779080.176725:0:10428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.176743:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.176799:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.176807:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.176814:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.176821:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779080.176825:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.176833:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.176849:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:3.0:1790779080.176853:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790779080.176862:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.176869:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d2a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779080.177004:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+32:11328:x1877767642731520:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 38805us (39002us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779080.177014:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00100000:2.0:1790779080.180157:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779080.180261:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642732160 00000100:00100000:0.0:1790779080.180270:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642732160 00000100:00100000:0.0:1790779080.180323:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:0.0:1790779080.180332:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+32:11328:x1877767642732160:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1790779080.180804:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+33:11328:x1877767642732160:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 470us (652us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1790779080.180812:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:3.0:1790779080.298275:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779080.298298:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663782784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779080.298367:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779080.298489:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663782784 00000100:00100000:0.0:1790779080.298499:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663782784 00000100:00100000:0.0:1790779080.298549:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790779080.298558:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663782784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779080.298593:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790779080.298642:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663782784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779080.298649:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790779080.298734:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663782784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779080.349557:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779080.349661:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642732416 00000100:00100000:2.0:1790779080.349672:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642732416 00000100:00100000:2.0:1790779080.349734:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:2.0:1790779080.349744:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+33:11339:x1877767642732416:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:2.0:1790779080.349778:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779080.349798:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d2b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.349903:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d2b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.349918:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.349930:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.349959:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d2be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.349967:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d2be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.349974:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d2be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350509:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d2c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350521:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350529:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779080.350540:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1790779080.350622:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350630:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d2b7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350636:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d2b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350642:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779080.350647:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d2b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350665:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d2b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350677:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:2.0:1790779080.350680:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779080.350685:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d2b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350691:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d2b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350703:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d2be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350708:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d2be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350714:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d2be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350719:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779080.350721:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d2be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350727:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d2be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350733:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7712a95b00) 00010000:00010000:2.0:1790779080.350736:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779080.350739:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d2be lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350755:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d2be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350799:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d2b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258bb expref: 36 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350812:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258bb expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.350819:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:2.0:1790779080.350821:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779080.350824:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3200, rc 0) 00000100:00100000:2.0:1790779080.350974:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+35:11339:x1877767642732416:12345-192.168.203.3@tcp:101:cat.0 Request processed in 1230us (1427us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1790779080.350992:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:1.0:1790779080.372489:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.372571:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642732672 00000100:00100000:3.0:1790779080.372582:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642732672 00000100:00100000:3.0:1790779080.372639:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1790779080.372649:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+35:11339:x1877767642732672:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:3.0:1790779080.373032:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+36:11339:x1877767642732672:12345-192.168.203.3@tcp:35:cat.0 Request processed in 384us (552us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1790779080.373041:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1790779080.417588:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779080.417690:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642732928 00000100:00100000:1.0:1790779080.417702:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642732928 00000100:00100000:1.0:1790779080.417773:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 106 00000100:00100000:1.0:1790779080.417783:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+36:11340:x1877767642732928:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:1.0:1790779080.417839:0:13003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1790779080.417874:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cf400/0xb1aa4014e936d263 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258a6 expref: 36 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.417925:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d2c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258bb expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.417936:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d29b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258b4 expref: 34 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.417946:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d255 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42589f expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.417957:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:1.0:1790779080.417961:0:13003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779080.418260:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418275:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418286:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418319:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418327:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418334:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418418:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418426:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418433:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779080.418637:0:13003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1790779080.418647:0:13003:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398425766309ns, next at 399425763729ns, rc = 0 00010000:00010000:1.0:1790779080.418689:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d2e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418698:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418706:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418713:0:13003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d2e8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418730:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d2e8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418736:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d2e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418812:0:13003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790779080.418832:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.418838:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2e1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419141:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419147:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779080.419151:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419159:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2e1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419188:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:1.0:1790779080.419192:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790779080.419196:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2e1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419211:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2e1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419246:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419273:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419278:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419282:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779080.419285:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419291:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419304:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:1.0:1790779080.419307:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779080.419311:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419316:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790779080.419332:0:13003:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000092880a78 reply state 0000000021184db1 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419342:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.419354:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b771d81af00) 00010000:00010000:1.0:1790779080.419357:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779080.419360:0:13003:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779080.419473:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+34:11340:x1877767642732928:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1688us (1893us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1790779080.419487:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 106 00010000:00010000:2.0:1790779080.420473:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779080.420481:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d2e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.420489:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779080.420493:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d2e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.420500:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d2e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.420512:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:2.0:1790779080.420515:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790779080.420529:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d2e8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.420535:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d2e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.420547:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779080.420549:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779080.420550:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779080.509565:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779080.509857:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642733184 00000100:00100000:1.0:1790779080.509868:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642733184 00000100:00100000:1.0:1790779080.509962:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 107 00000100:00100000:1.0:1790779080.509973:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+34:11346:x1877767642733184:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1790779080.509998:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779080.510018:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258c2 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.510133:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.510148:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.510159:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.510351:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.510360:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.510367:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790779080.510685:0:13821:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1790779080.513081:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d304 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513384:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513399:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513443:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513451:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2f6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513458:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513464:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779080.513469:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513475:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513486:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:1.0:1790779080.513489:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779080.513494:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513501:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d2f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790779080.513516:0:13821:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000054c882b reply state 000000009bca9c1e transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513537:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513543:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b771d81af00) 00010000:00010000:1.0:1790779080.513546:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779080.513548:0:13821:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790779080.513589:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d2ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c2 expref: 37 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513604:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c2 expref: 36 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.513610:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b771d81a000) 00010000:00010000:1.0:1790779080.513612:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779080.513614:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6400, rc 0) 00000100:00100000:1.0:1790779080.513810:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+37:11346:x1877767642733184:12345-192.168.203.3@tcp:101:bash.0 Request processed in 3838us (4253us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1790779080.513819:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 107 00000100:00100000:0.0:1790779080.532747:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.532869:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642733312 00000100:00100000:3.0:1790779080.532920:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642733312 00000100:00100000:3.0:1790779080.532982:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1790779080.532992:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642733312:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779080.533009:0:8855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779080.533031:0:8855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d312 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258c9 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779080.533055:0:8855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779080.533073:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:3.0:1790779080.533092:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779080.533102:0:8855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d312 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c9 expref: 6 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.533134:0:8855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d312 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c9 expref: 6 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.533148:0:8855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662a00, rc 0) 00000100:00080000:1.0:1790779080.533257:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779080.533385:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2399:x1877767642733312:12345-192.168.203.3@tcp:101:bash.0 Request processed in 394us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779080.533392:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:0.0:1790779080.540655:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.540766:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642733440 00000100:00100000:3.0:1790779080.540776:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642733440 00000100:00100000:3.0:1790779080.540832:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:3.0:1790779080.540852:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:11346:x1877767642733440:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779080.540872:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779080.540925:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258d0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.540957:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d312 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c9 expref: 7 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.540966:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779080.540971:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779080.540977:0:8439:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.541029:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d312 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c9 expref: 7 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.541043:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d312 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c9 expref: 7 pid: 8855 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779080.541057:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1877767663782912:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779080.541175:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760345bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779080.546542:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779080.546625:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642733568 00000100:00100000:0.0:1790779080.546636:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642733568 00010000:00010000:0.0:1790779080.546674:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d312 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c9 expref: 8 pid: 8855 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779080.546719:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:0.0:1790779080.546729:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642733568:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779080.546744:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779080.546777:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d312 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c9 expref: 8 pid: 8855 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.546791:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d312 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c9 expref: 8 pid: 8855 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.546816:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779080.546834:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779080.546844:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.546854:0:6509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.546932:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779080.546948:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1877767663783040:192.168.203.3@tcp:105: 00000100:00100000:0.0:1790779080.547018:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1540 going to sleep for 11 seconds 00010000:00010000:3.0:1790779080.547585:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d312 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c9 expref: 8 pid: 8855 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779080.547602:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1877767663782912:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779080.547627:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.547637:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662800, rc 0) 00000100:00100000:3.0:1790779080.547691:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:11346:x1877767642733440:12345-192.168.203.3@tcp:101:bash.0 Request processed in 6849us (7045us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779080.547700:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:2.0:1790779080.562687:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.562776:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642733824 00000100:00100000:3.0:1790779080.562786:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642733824 00000100:00100000:3.0:1790779080.562857:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1790779080.562868:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+37:11346:x1877767642733824:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:3.0:1790779080.563583:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+38:11346:x1877767642733824:12345-192.168.203.3@tcp:35:bash.0 Request processed in 715us (903us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1790779080.563601:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:0.0:1790779080.569384:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1877767663783040:192.168.203.3@tcp:105: 00010000:00010000:0.0:1790779080.569417:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779080.569502:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642733568:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 22773us (22970us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779080.569513:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00010000:00010000:1.0:1790779080.616308:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779080.861747:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.861911:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642733952 00000100:00100000:3.0:1790779080.861921:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642733952 00000100:00100000:3.0:1790779080.861990:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 108 00000100:00100000:3.0:1790779080.862000:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+38:11362:x1877767642733952:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779080.862025:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779080.862045:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d320 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.862109:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d327 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.862122:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.862138:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779080.862192:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790779080.862203:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779080.862222:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.862314:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d7 expref: 40 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.862336:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d327 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d7 expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.862369:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779080.862372:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779080.862375:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663600, rc 0) 00000100:00100000:3.0:1790779080.862441:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+39:11362:x1877767642733952:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 442us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779080.862448:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 108 00000100:00100000:1.0:1790779080.869488:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779080.869573:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642734208 00000100:00100000:0.0:1790779080.869582:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642734208 00000100:00100000:0.0:1790779080.869640:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 109 00000100:00100000:0.0:1790779080.869649:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+39:11362:x1877767642734208:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1790779080.869670:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779080.869688:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d32e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258de expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.869797:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d335 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.869825:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.869836:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779080.869848:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790779080.870001:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d32e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258de expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.870018:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258de expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779080.870026:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b771d81a000) 00010000:00010000:0.0:1790779080.870029:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790779080.870033:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769400, rc 0) 00000100:00100000:0.0:1790779080.870352:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+41:11362:x1877767642734208:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 703us (872us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1790779080.870359:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 109 00000100:00100000:0.0:1790779080.875375:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779080.875442:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779080.875505:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642734592 00000100:00100000:2.0:1790779080.875515:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642734592 00000100:00100000:3.0:1790779080.875600:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642734464 00000100:00100000:3.0:1790779080.875605:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642734464 00000100:00100000:2.0:1790779080.875626:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1790779080.875638:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+42:2400:x1877767642734592:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790779080.875651:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 110 00010000:00010000:2.0:1790779080.875654:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790779080.875663:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+42:11362:x1877767642734464:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779080.875691:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d335 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258de expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.875709:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b771d81a000) 00010000:00010000:2.0:1790779080.875714:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779080.875754:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779080.875770:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d343 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258e5 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779080.875776:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+41:2400:x1877767642734592:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 139us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779080.875789:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00010000:00010000:3.0:1790779080.875869:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d34a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.875905:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d34a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.875916:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d34a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779080.875928:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790779080.877507:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d343 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258e5 expref: 43 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.877562:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d34a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258e5 expref: 42 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.877571:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b771d81a000) 00010000:00010000:3.0:1790779080.877574:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790779080.877577:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663400, rc 0) 00000100:00100000:3.0:1790779080.877638:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+42:11362:x1877767642734464:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1978us (2271us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1790779080.877645:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 110 00000100:00100000:0.0:1790779080.902720:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.903176:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642734720 00000100:00100000:3.0:1790779080.903187:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642734720 00000100:00100000:3.0:1790779080.903259:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:3.0:1790779080.903268:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642734720:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:3.0:1790779080.903311:0:8855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.903331:0:8855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.903340:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779080.903345:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790779080.903349:0:8855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.903382:0:8855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.903407:0:8855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 6 pid: 8439 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779080.903421:0:8855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8855:1877767663783168:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779080.903518:0:8855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711962180 going to sleep for 11 seconds 00000100:00100000:3.0:1790779080.907792:0:8855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8855:1877767663783168:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779080.907821:0:8855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779080.911277:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779080.911438:0:8445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642734848 00000100:00100000:2.0:1790779080.911449:0:8445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642734848 00002000:00100000:2.0:1790779080.911501:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9b760448fb80 x1877767642734848/t0(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:631/0 lens 504/0 e 0 to 0 dl 1790779091 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779080.911547:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760448fb80 with x1877767642734848 ext(0->8) 00010000:00010000:2.0:1790779080.911559:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 7 pid: 8439 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.911578:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 7 pid: 8439 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779080.911586:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b760448fb80 00000100:00100000:2.0:1790779080.911628:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:2.0:1790779080.911639:0:8445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2401:x1877767642734848:12345-192.168.203.3@tcp:4:lfs.0 00000100:00100000:2.0:1790779080.914520:0:8445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2401:x1877767642734848:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 2874us (3245us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790779080.914534:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00002000:00100000:2.0:1790779080.914547:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9b760448fb80 x1877767642734848/t4294967303(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:631/0 lens 504/448 e 0 to 0 dl 1790779091 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779080.914558:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760448fb80 with x1877767642734848 ext(0->8) 00010000:00010000:2.0:1790779080.914570:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 9 pid: 8439 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.914589:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 9 pid: 8439 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779080.914598:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b760448fb80 00000100:00100000:2.0:1790779080.925295:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779080.925415:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642734976 00000100:00100000:1.0:1790779080.925425:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642734976 00010000:00010000:1.0:1790779080.925467:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 9 pid: 8439 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779080.925511:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:1.0:1790779080.925520:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff61c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2401:x1877767642734976:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779080.925541:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790779080.925557:0:6510:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790779080.925560:0:6510:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790779080 00002000:00010000:1.0:1790779080.925563:0:6510:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790779080 00002000:00010000:1.0:1790779080.925565:0:6510:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1790779080 00002000:00010000:1.0:1790779080.925567:0:6510:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1790779080.925574:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 9 pid: 8439 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.925588:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 9 pid: 8439 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.925610:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005637871d/0xb1aa4014e936d319 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d0 expref: 9 pid: 8439 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.925628:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779080.925632:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779080.925638:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.925648:0:6510:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.925681:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779080.925738:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff61c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642734976:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 218us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779080.925745:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00010000:00010000:3.0:1790779080.925914:0:8855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.925924:0:8855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.925954:0:8855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.925970:0:8855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.925978:0:8855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.925999:0:8855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779080.926003:0:8855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.926013:0:8855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.926025:0:8855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.926033:0:8855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd54af34/0xb1aa4014e936d358 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779080.926082:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642734720:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 22815us (23371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779080.926090:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:3.0:1790779080.931583:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779080.931781:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642735232 00000100:00100000:2.0:1790779080.931792:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642735232 00000100:00100000:2.0:1790779080.931850:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:2.0:1790779080.931860:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718265c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+42:11362:x1877767642735232:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:2.0:1790779080.932086:0:6527:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d34a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258e5 expref: 42 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790779080.932557:0:6527:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1790779080.932595:0:6527:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1790779080.934098:0:6527:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1790779080.934148:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.934169:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d304 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c2 expref: 46 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.934179:0:6527:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.934233:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c2 expref: 46 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.934259:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d304 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c2 expref: 46 pid: 13821 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779080.934276:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1877767663783296:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779080.934360:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779080.942473:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.942697:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1877767663783296:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779080.942723:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779080.942982:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642735360 00000100:00100000:1.0:1790779080.942991:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642735360 00010000:00010000:1.0:1790779080.943026:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d304 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c2 expref: 47 pid: 13821 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779080.943065:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:1.0:1790779080.943073:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+47:2400:x1877767642735360:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779080.943088:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779080.943095:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d304 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c2 expref: 47 pid: 13821 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.943108:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c2 expref: 47 pid: 13821 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.943129:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d304 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258c2 expref: 47 pid: 13821 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.943144:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b771d81a000) 00010000:00010000:1.0:1790779080.943149:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.943158:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.943165:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.943188:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779080.943257:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+46:2400:x1877767642735360:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 173us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779080.943279:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00010000:00010000:3.0:1790779080.943572:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.943580:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790779080.943719:0:6527:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1790779080.943837:0:6527:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1790779080.943964:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044e9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1877767663783424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790779080.944015:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779080.944045:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711962a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790779080.944432:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663783424 00000100:00100000:1.0:1790779080.944439:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663783424 00000100:00100000:1.0:1790779080.944481:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790779080.944489:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1877767663783424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790779080.944573:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1877767663783424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779080.944581:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790779080.944662:0:6527:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1790779080.944684:0:6527:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1790779080.944703:0:6527:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603843100, transno 4294967302 00000100:00100000:2.0:1790779080.944716:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044e9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1877767663783424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790779080.944828:0:6527:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1790779080.944874:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ac700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1877767663783552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790779080.944932:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779080.944950:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c540 going to sleep for 11 seconds 00000100:00100000:1.0:1790779080.945577:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663783552 00000100:00100000:1.0:1790779080.945583:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663783552 00000100:00100000:1.0:1790779080.945611:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790779080.945775:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1877767663783552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790779080.945925:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6527:x1877767663783552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 153us (991us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790779080.945932:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790779080.946929:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ac700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1877767663783552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790779080.947005:0:6527:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1790779080.947051:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.947063:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.947070:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.947077:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779080.947081:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.947089:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.947105:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b771d81a000) 00010000:00010000:2.0:1790779080.947108:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790779080.947113:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.947138:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d35f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790779080.947353:0:6527:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790779080.947415:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1790779080.947427:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398954546939ns, next at 399954544494ns, rc = 0 00000001:00080000:2.0:1790779080.947433:0:6527:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1790779080.947457:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b771d81a000) 00010000:00010000:2.0:1790779080.947460:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790779080.947467:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d34a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258e5 expref: 50 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779080.947620:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718265c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+49:11362:x1877767642735232:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 15760us (16045us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1790779080.947637:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000020:00080000:2.0:1790779080.947642:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790779080.964437:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.964567:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642735488 00000100:00100000:3.0:1790779080.964577:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642735488 00000100:00100000:3.0:1790779080.964647:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 111 00000100:00100000:3.0:1790779080.964657:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+49:11362:x1877767642735488:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779080.966930:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779080.967171:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d366 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258ec expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.967261:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d366 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ec expref: 50 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.967278:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d366 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ec expref: 50 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779080.967297:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:2.0:1790779080.967314:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790779080.967319:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2c00, rc 0) 00000100:00100000:2.0:1790779080.967426:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+50:11362:x1877767642735488:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 2770us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779080.967434:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 111 00000100:00100000:1.0:1790779080.985425:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779080.985778:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642735744 00000100:00100000:3.0:1790779080.985789:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642735744 00000100:00100000:3.0:1790779080.985918:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:3.0:1790779080.985928:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+50:11362:x1877767642735744:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779080.986145:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+51:11362:x1877767642735744:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 219us (730us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1790779080.986152:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1790779081.150547:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779081.150852:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642735872 00000100:00100000:0.0:1790779081.150862:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642735872 00000100:00100000:0.0:1790779081.150985:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 112 00000100:00100000:0.0:1790779081.150996:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+51:11372:x1877767642735872:12345-192.168.203.3@tcp:34:lfs.0 00000100:00080000:1.0:1790779081.151139:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790779081.151515:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d36d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151533:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d36d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151547:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d36d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151559:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d374 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151567:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d374 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151574:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d374 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151655:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d37b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151672:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151680:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790779081.151726:0:13003:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151738:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d36d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151755:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d36d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151762:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d36d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151768:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779081.151772:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d36d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151780:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d36d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151792:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:0.0:1790779081.151795:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779081.151800:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d36d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151806:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d36d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151819:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d374 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151825:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d374 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151831:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d374 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151836:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779081.151845:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d374 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151852:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d374 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151859:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b771d81af00) 00010000:00010000:0.0:1790779081.151862:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779081.151865:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d374 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151870:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d374 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151914:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151921:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d37b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151927:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d37b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151931:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779081.151945:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d37b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151952:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d37b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151967:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:0.0:1790779081.151970:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779081.151980:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d37b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.151986:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d37b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779081.152407:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+51:11372:x1877767642735872:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 1412us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779081.152417:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 112 00000100:00100000:0.0:1790779081.222463:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779081.222574:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642736128 00000100:00100000:1.0:1790779081.222585:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642736128 00000100:00100000:1.0:1790779081.222645:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:1.0:1790779081.222656:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+51:11375:x1877767642736128:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779081.222688:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779081.222711:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d382 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258f3 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.222804:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d389 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.222818:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d389 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.222829:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d389 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.222839:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d390 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.222846:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d390 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.222853:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d390 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223017:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d397 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223025:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d397 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223033:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d397 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779081.223042:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790779081.223129:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d389 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223146:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d389 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223154:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d389 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223159:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779081.223516:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d389 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223526:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d389 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223539:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:1.0:1790779081.223542:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779081.223547:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d389 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223554:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d389 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223569:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d390 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223575:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d390 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223581:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d390 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223587:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779081.223598:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d390 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223605:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d390 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223613:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b771d81af00) 00010000:00010000:1.0:1790779081.223616:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779081.223620:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d390 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223625:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d390 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223675:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d382 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258f3 expref: 54 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223691:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d397 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258f3 expref: 53 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.223699:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779081.223701:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779081.223703:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6000, rc 0) 00000100:00100000:1.0:1790779081.223778:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+53:11375:x1877767642736128:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1124us (1323us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1790779081.223786:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:1.0:1790779081.243708:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779081.243870:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642736256 00000100:00100000:2.0:1790779081.243909:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642736256 00000100:00100000:2.0:1790779081.243992:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:2.0:1790779081.244001:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+53:11375:x1877767642736256:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:2.0:1790779081.244076:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d3a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.244092:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.244104:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.244138:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.244145:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d3a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.244152:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.244158:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779081.244162:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.244187:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d3a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.244207:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:2.0:1790779081.244211:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779081.244215:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d3a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.244221:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d3a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779081.244293:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+53:11375:x1877767642736256:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 293us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779081.244302:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:2.0:1790779081.248135:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.249135:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642736512 00000100:00100000:3.0:1790779081.249146:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642736512 00000100:00100000:3.0:1790779081.249212:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:3.0:1790779081.249223:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+53:11375:x1877767642736512:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779081.249455:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+54:11375:x1877767642736512:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 233us (1328us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1790779081.249463:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:0.0:1790779081.370835:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.370971:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642736768 00000100:00100000:3.0:1790779081.370982:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642736768 00000100:00100000:3.0:1790779081.371053:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:3.0:1790779081.371064:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+54:11385:x1877767642736768:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779081.371088:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.371091:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790779081.371115:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d327 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258d7 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.371134:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779081.371139:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779081.371150:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d3ac lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4258fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.371263:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d3b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.371278:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.371289:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779081.371299:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790779081.371395:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d3ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258fa expref: 56 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.371410:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d3b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258fa expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.371417:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:3.0:1790779081.371426:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779081.371429:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662000, rc 0) 00000100:00100000:3.0:1790779081.371487:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+55:11385:x1877767642736768:12345-192.168.203.3@tcp:101:bash.0 Request processed in 426us (660us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1790779081.371494:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:1.0:1790779081.379546:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779081.379646:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642736896 00000100:00100000:0.0:1790779081.379656:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642736896 00000100:00100000:0.0:1790779081.379724:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:0.0:1790779081.379734:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+55:11385:x1877767642736896:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1790779081.379756:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779081.379777:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d3c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425901 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.379809:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d3c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.379824:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.379835:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.379974:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d3c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425901 expref: 57 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.380004:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425901 expref: 56 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.380013:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:0.0:1790779081.380016:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790779081.380020:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768800, rc 0) 00000100:00100000:0.0:1790779081.383069:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+56:11385:x1877767642736896:12345-192.168.203.3@tcp:101:bash.0 Request processed in 3324us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779081.383083:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:2.0:1790779081.390873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.398748:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642737024 00000100:00100000:3.0:1790779081.398769:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642737024 00000100:00100000:3.0:1790779081.398835:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1790779081.398845:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+56:2400:x1877767642737024:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779081.398860:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779081.398897:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d3b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258fa expref: 56 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.398915:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:3.0:1790779081.398920:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779081.398992:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+55:2400:x1877767642737024:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 148us (8127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.399000:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:2.0:1790779081.400399:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.401056:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642737280 00000100:00100000:3.0:1790779081.401067:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642737280 00000100:00100000:2.0:1790779081.401253:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:2.0:1790779081.401265:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+55:11385:x1877767642737280:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:2.0:1790779081.401320:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779081.401349:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d397 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258f3 expref: 55 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.401370:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:2.0:1790779081.401375:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779081.401540:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.401573:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.401582:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779081.401929:0:6524:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1790779081.401971:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004ed4d1e6 reply state 00000000c3b9da52 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.401993:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.402000:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779081.402002:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779081.402005:0:6524:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779081.402107:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+57:11385:x1877767642737280:12345-192.168.203.3@tcp:36:bash.0 Request processed in 844us (1712us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1790779081.402115:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 117 00000020:00080000:1.0:1790779081.402120:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790779081.407984:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.408328:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642737408 00000100:00100000:3.0:1790779081.408338:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642737408 00000100:00100000:3.0:1790779081.408391:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:3.0:1790779081.408400:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+57:11385:x1877767642737408:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779081.408421:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.408438:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d3d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425908 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.408545:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.408560:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.408571:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779081.408598:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790779081.408602:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779081.408631:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.408678:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d3d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425908 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.408696:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425908 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.408705:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:3.0:1790779081.408708:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779081.408712:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663600, rc 0) 00000100:00100000:3.0:1790779081.408773:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+58:11385:x1877767642737408:12345-192.168.203.3@tcp:101:bash.0 Request processed in 373us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.408780:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:2.0:1790779081.423386:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.423467:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642737664 00000100:00100000:3.0:1790779081.423477:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642737664 00000100:00100000:3.0:1790779081.423550:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:3.0:1790779081.423560:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+58:11385:x1877767642737664:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:3.0:1790779081.423770:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+59:11385:x1877767642737664:12345-192.168.203.3@tcp:35:bash.0 Request processed in 211us (392us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1790779081.423778:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:1.0:1790779081.573482:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.573754:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642737792 00000100:00100000:3.0:1790779081.573764:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642737792 00000100:00100000:3.0:1790779081.573822:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:3.0:1790779081.573832:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+59:11391:x1877767642737792:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779081.573855:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.573875:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d3e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42590f expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.573976:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d3eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.573988:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.573998:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779081.574037:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790779081.574041:0:10428:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779081.574057:0:10428:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.574079:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d3e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42590f expref: 61 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.574126:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d3eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42590f expref: 60 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.574135:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779081.574138:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779081.574142:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662000, rc 0) 00000100:00100000:3.0:1790779081.574496:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+60:11391:x1877767642737792:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 665us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.574503:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:1.0:1790779081.578435:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.578514:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642737920 00000100:00100000:3.0:1790779081.578524:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642737920 00000100:00100000:3.0:1790779081.578592:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:3.0:1790779081.578601:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+60:11391:x1877767642737920:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779081.578620:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.578637:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d3f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425916 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578694:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d3f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578709:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578719:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578731:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d400 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578754:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d400 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578761:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d400 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578839:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578849:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578857:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779081.578928:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790779081.578932:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779081.578948:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578959:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578968:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578974:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d3f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578982:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.578998:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779081.579002:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579010:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d3f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579021:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779081.579024:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779081.579029:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d3f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579034:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d3f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579048:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d400 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579055:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d400 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579060:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d400 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579065:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779081.579068:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d400 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579073:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d400 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579091:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b771d81af00) 00010000:00010000:3.0:1790779081.579094:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779081.579097:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d400 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579104:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d400 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579135:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d3f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425916 expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579149:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425916 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.579156:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:3.0:1790779081.579158:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779081.579160:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663800, rc 0) 00000100:00100000:3.0:1790779081.579235:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+61:11391:x1877767642737920:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 634us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.579242:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:2.0:1790779081.583217:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779081.583259:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779081.583344:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642738048 00000100:00100000:1.0:1790779081.583354:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642738048 00000100:00100000:1.0:1790779081.583415:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:1.0:1790779081.583425:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+61:2401:x1877767642738048:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779081.583441:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779081.583465:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d407 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425916 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.583485:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779081.583489:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779081.583541:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+60:2401:x1877767642738048:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 117us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779081.583549:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1790779081.583815:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642738304 00000100:00100000:3.0:1790779081.583820:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642738304 00000100:00100000:3.0:1790779081.583864:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:3.0:1790779081.583871:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+60:11391:x1877767642738304:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779081.583910:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.583926:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d40e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42591d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.584044:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.584059:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425908 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.584067:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.584098:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425908 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.584112:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425908 expref: 61 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779081.584125:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663783680:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779081.584208:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711962300 going to sleep for 11 seconds 00000100:00100000:2.0:1790779081.588731:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.588957:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663783680:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779081.588990:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.589642:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642738432 00000100:00100000:1.0:1790779081.589734:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642738432 00010000:00010000:1.0:1790779081.589773:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425908 expref: 62 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.589999:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:1.0:1790779081.590010:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+62:2400:x1877767642738432:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779081.590025:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779081.590032:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425908 expref: 62 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.590045:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425908 expref: 62 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.590065:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d3dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425908 expref: 62 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.590080:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779081.590084:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.590094:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.590102:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.590140:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779081.590226:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+61:2400:x1877767642738432:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 218us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779081.590244:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00010000:00010000:3.0:1790779081.590292:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.590300:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779081.590317:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790779081.590441:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d40e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42591d expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.590455:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42591d expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.590463:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:3.0:1790779081.590465:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790779081.590468:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663000, rc 0) 00000100:00100000:3.0:1790779081.590493:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+61:11391:x1877767642738304:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 6623us (7286us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1790779081.590500:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:1.0:1790779081.597916:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779081.598120:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642738688 00000100:00100000:2.0:1790779081.598130:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642738688 00000100:00100000:2.0:1790779081.598211:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:2.0:1790779081.598221:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+61:11391:x1877767642738688:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:2.0:1790779081.598237:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779081.598270:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d366 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ec expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.598289:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:2.0:1790779081.598295:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779081.598353:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+60:11391:x1877767642738688:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 134us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779081.598360:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1790779081.603619:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.603753:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642738816 00000100:00100000:3.0:1790779081.603763:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642738816 00000100:00100000:3.0:1790779081.603818:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:3.0:1790779081.603828:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+60:11391:x1877767642738816:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:3.0:1790779081.604048:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.604066:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.604078:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790779081.604444:0:10428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1790779081.604586:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+60:11391:x1877767642738816:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 758us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.604594:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:3.0:1790779081.612642:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779081.612922:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642738944 00000100:00100000:1.0:1790779081.612933:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642738944 00000100:00100000:1.0:1790779081.612982:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:1.0:1790779081.612992:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+60:11391:x1877767642738944:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779081.613011:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779081.613033:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936d42a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425924 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.613085:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.613095:0:6524:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936d42a lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425924 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.613126:0:6524:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.613140:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936d42a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425924 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.613153:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779081.613156:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779081.613170:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936d42a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425924 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.613179:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6600, rc 0) 00000100:00100000:1.0:1790779081.613500:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+61:11391:x1877767642738944:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 508us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779081.613508:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 123 00010000:00010000:2.0:1790779081.642031:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790779081.833774:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790779081.834100:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790779081.834151:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1790779081.834178:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790779081.834347:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044eb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663783808:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790779081.834507:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711962f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779081.851423:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.851534:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044eb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663783808:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790779081.851916:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642739072 00000100:00100000:1.0:1790779081.851923:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642739072 00000100:00100000:1.0:1790779081.852030:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:1.0:1790779081.852039:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+61:11392:x1877767642739072:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790779081.852067:0:13003:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790779081.852432:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+61:11392:x1877767642739072:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 393us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779081.852440:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:0.0:1790779081.866484:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779081.866787:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642739200 00000100:00100000:1.0:1790779081.866798:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642739200 00000100:00100000:1.0:1790779081.866859:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:1.0:1790779081.866869:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+61:11392:x1877767642739200:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790779081.866984:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d431 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867002:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d431 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867015:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d431 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867030:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d438 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867038:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d438 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867065:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d438 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867088:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d43f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867097:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d43f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867113:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d43f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779081.867158:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790779081.867163:0:13821:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779081.867194:0:13821:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d43f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867206:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d431 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867220:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d431 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867228:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d431 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867234:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779081.867238:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d431 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867246:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d431 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867267:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:1.0:1790779081.867271:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779081.867277:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d431 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867284:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d431 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867297:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d438 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867304:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d438 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867309:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d438 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867315:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779081.867317:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d438 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867323:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d438 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867330:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9b771d81ac00) 00010000:00010000:1.0:1790779081.867332:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779081.867335:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d438 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867341:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d438 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867367:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d43f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867373:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d43f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867379:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d43f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867384:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779081.867387:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d43f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867393:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d43f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867401:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779081.867404:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779081.867408:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d43f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.867414:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d43f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.867491:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+61:11392:x1877767642739200:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 623us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779081.867498:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:2.0:1790779081.874476:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.876539:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642739456 00000100:00100000:3.0:1790779081.876553:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642739456 00000100:00100000:3.0:1790779081.876632:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:3.0:1790779081.876643:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+61:11392:x1877767642739456:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779081.876673:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.876693:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d446 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42592b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.876801:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d44d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.876816:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.876827:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779081.876839:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790779081.877320:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.877346:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d44d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.877354:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d44d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.877360:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779081.877365:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d44d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.877372:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d44d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.877385:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:3.0:1790779081.877389:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790779081.877394:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d44d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.877400:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d44d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.877445:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d446 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42592b expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.877455:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:3.0:1790779081.877457:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790779081.877460:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d446 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42592b expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.877469:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662c00, rc 0) 00000100:00100000:3.0:1790779081.878092:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+62:11392:x1877767642739456:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1447us (3620us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1790779081.878101:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:2.0:1790779081.901434:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779081.903196:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642739584 00000100:00100000:1.0:1790779081.903220:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642739584 00000100:00100000:2.0:1790779081.903456:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:2.0:1790779081.903467:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+62:11392:x1877767642739584:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790779081.903503:0:13003:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790779081.903633:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+62:11392:x1877767642739584:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 167us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779081.903640:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:2.0:1790779081.917980:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779081.918137:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642739840 00000100:00100000:1.0:1790779081.918161:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642739840 00000100:00100000:1.0:1790779081.918243:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:1.0:1790779081.918252:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+62:11392:x1877767642739840:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779081.918271:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779081.918274:0:13821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790779081.918298:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d3eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42590f expref: 62 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.918316:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:1.0:1790779081.918320:0:13821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779081.918332:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d45b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425932 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790779081.918682:0:13821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1790779081.918820:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.918833:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.918843:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.918926:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d45b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425932 expref: 64 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.919597:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425932 expref: 63 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.919633:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b771d81ac00) 00010000:00010000:1.0:1790779081.919636:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779081.919639:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6e00, rc 0) 00000100:00100000:2.0:1790779081.929650:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+63:11392:x1877767642739840:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 11388us (11668us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1790779081.929671:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:2.0:1790779081.934152:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.934300:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642740096 00000100:00100000:3.0:1790779081.934310:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642740096 00000100:00100000:3.0:1790779081.934373:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:3.0:1790779081.934384:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+63:11392:x1877767642740096:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790779081.934441:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779081.934466:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d462 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425932 expref: 63 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934486:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b771d81ac00) 00010000:00010000:3.0:1790779081.934497:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779081.934518:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d470 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934532:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d470 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934543:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d470 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934557:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d477 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x93090e7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934564:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x93090e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934571:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x93090e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934634:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d470 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934642:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d470 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934649:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d470 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934655:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779081.934673:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d470 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934682:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d470 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934691:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779081.934694:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779081.934698:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d470 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934703:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d470 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934713:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x93090e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934719:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d477 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x93090e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934725:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d477 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x93090e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934736:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779081.934739:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d477 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x93090e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934745:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d477 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x93090e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934754:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x93090e7d (ffff9b7705528400) 00010000:00010000:3.0:1790779081.934756:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779081.934758:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d477 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x93090e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.934764:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d477 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x93090e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779081.934832:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+62:11392:x1877767642740096:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 450us (689us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790779081.934839:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:3.0:1790779081.938761:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779081.939128:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642740224 00000100:00100000:2.0:1790779081.939138:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642740224 00000100:00100000:2.0:1790779081.939223:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:2.0:1790779081.939233:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+62:11392:x1877767642740224:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779081.939263:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779081.939286:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d47e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425939 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.939320:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d485 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.939332:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.939343:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.939461:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d47e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425939 expref: 64 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.939479:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425939 expref: 63 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.939488:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:2.0:1790779081.939492:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790779081.939495:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3400, rc 0) 00000100:00100000:2.0:1790779081.939561:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+63:11392:x1877767642740224:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 329us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779081.939568:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:2.0:1790779081.955926:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.956036:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642740480 00000100:00100000:3.0:1790779081.956046:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642740480 00000100:00100000:3.0:1790779081.956113:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:3.0:1790779081.956124:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+63:11392:x1877767642740480:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790779081.956471:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.956489:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.956513:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790779081.956797:0:10428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1790779081.956808:0:10428:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399963927360ns, next at 400963924530ns, rc = 0 00000004:00010000:3.0:1790779081.956856:0:10428:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000476e2bc0 reply state 000000007e04f875 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.956869:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.956904:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:3.0:1790779081.956908:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790779081.956913:0:10428:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790779081.957004:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+65:11392:x1877767642740480:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 882us (1086us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1790779081.957012:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:1.0:1790779081.960554:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.960963:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642740608 00000100:00100000:3.0:1790779081.960974:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642740608 00000100:00100000:3.0:1790779081.961034:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:3.0:1790779081.961043:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+65:11392:x1877767642740608:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779081.961067:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.961088:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d493 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425940 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.961148:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d493 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425940 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.961205:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d493 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425940 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.961440:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:3.0:1790779081.961444:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790779081.961448:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662c00, rc 0) 00000100:00100000:3.0:1790779081.961510:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+66:11392:x1877767642740608:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 467us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.961517:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:0.0:1790779081.982139:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.982552:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642740736 00000100:00100000:3.0:1790779081.982562:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642740736 00000100:00100000:3.0:1790779081.982639:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:3.0:1790779081.982650:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642740736:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790779081.982908:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2401:x1877767642740736:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 232us (748us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790779081.982917:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00080000:1.0:1790779081.983092:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779081.985977:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779081.986300:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642740992 00000100:00100000:3.0:1790779081.986310:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642740992 00000100:00100000:3.0:1790779081.986369:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1790779081.986379:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+66:11392:x1877767642740992:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790779081.987059:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+67:11392:x1877767642740992:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 677us (1085us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1790779081.987068:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:2.0:1790779081.992678:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779081.992777:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642741248 00000100:00100000:0.0:1790779081.992788:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642741248 00000100:00100000:0.0:1790779081.992851:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:0.0:1790779081.992862:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+67:11392:x1877767642741248:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790779081.993023:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+67:11392:x1877767642741248:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 163us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779081.993031:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:2.0:1790779082.013322:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779082.013429:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642741376 00000100:00100000:3.0:1790779082.013449:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642741376 00000100:00100000:3.0:1790779082.013508:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:3.0:1790779082.013518:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+67:11392:x1877767642741376:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779082.013540:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779082.013561:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d49a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425947 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.013627:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.013642:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.013656:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779082.013701:0:10428:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779082.013723:0:10428:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.013750:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d49a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425947 expref: 69 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.013767:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425947 expref: 68 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.013774:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:3.0:1790779082.013777:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790779082.013781:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663a00, rc 0) 00000100:00100000:3.0:1790779082.013852:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+68:11392:x1877767642741376:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 335us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.013866:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:2.0:1790779082.021459:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.022969:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642741504 00000100:00100000:1.0:1790779082.022985:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642741504 00000100:00100000:1.0:1790779082.023054:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:1.0:1790779082.023063:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2400:x1877767642741504:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779082.023081:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779082.023103:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42594e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790779082.023128:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd1ec9, blocks: 0x0 00010000:00010000:1.0:1790779082.023146:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1790779082.023151:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779082.023873:0:8438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42594e expref: 10 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.024035:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42594e expref: 10 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.024051:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7600, rc 0) 00000100:00100000:1.0:1790779082.024194:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+10:2400:x1877767642741504:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1121us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.024229:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:1.0:1790779082.029120:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779082.029206:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642741760 00000100:00100000:2.0:1790779082.029227:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642741760 00000100:00100000:2.0:1790779082.029492:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:2.0:1790779082.029504:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+68:11392:x1877767642741760:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790779082.029619:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+68:11392:x1877767642741760:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 118us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.029627:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:2.0:1790779082.039089:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779082.039249:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642741888 00000100:00100000:3.0:1790779082.039260:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642741888 00000100:00100000:3.0:1790779082.039359:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:3.0:1790779082.039369:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+10:11392:x1877767642741888:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779082.039388:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779082.039406:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425955 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.039439:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42594e expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.039449:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779082.039453:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779082.039459:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.039488:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42594e expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.039502:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42594e expref: 11 pid: 8438 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.039516:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1877767663783936:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779082.039608:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711962f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779082.046023:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779082.046220:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1877767663783936:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779082.046264:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.046286:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663400, rc 0) 00000100:00100000:3.0:1790779082.046344:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+11:11392:x1877767642741888:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 6976us (7263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.046353:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:1.0:1790779082.046470:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642742016 00000100:00100000:1.0:1790779082.046477:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642742016 00010000:00010000:1.0:1790779082.046507:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42594e expref: 11 pid: 8438 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.046533:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:1.0:1790779082.046540:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+11:2400:x1877767642742016:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779082.046551:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779082.046569:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42594e expref: 11 pid: 8438 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.046581:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42594e expref: 11 pid: 8438 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.046603:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42594e expref: 11 pid: 8438 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.046615:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779082.046619:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779082.046626:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.046636:0:6509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.048039:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.048060:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1877767663784064:192.168.203.3@tcp:105: 00000100:00100000:1.0:1790779082.048133:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77201636c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779082.060670:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1877767663784064:192.168.203.3@tcp:105: 00010000:00010000:1.0:1790779082.060698:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779082.060756:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+10:2400:x1877767642742016:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 14215us (14741us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.060769:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:2.0:1790779082.072418:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779082.072598:0:8444:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642742144 00000100:00100000:0.0:1790779082.072620:0:8444:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642742144 00002000:00100000:0.0:1790779082.072778:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9b7603a59c00 x1877767642742144/t0(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:633/0 lens 504/0 e 0 to 0 dl 1790779093 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790779082.072791:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603a59c00 with x1877767642742144 ext(0->12) 00002000:00010000:0.0:1790779082.072798:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603a59c00 00000100:00100000:0.0:1790779082.072848:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:0.0:1790779082.072857:0:8444:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+10:2400:x1877767642742144:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790779082.080127:0:8444:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+12:2400:x1877767642742144:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 7259us (7707us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790779082.080148:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00002000:00100000:1.0:1790779082.080162:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9b7603a59c00 x1877767642742144/t4294967309(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:633/0 lens 504/448 e 0 to 0 dl 1790779093 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790779082.080174:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603a59c00 with x1877767642742144 ext(0->12) 00002000:00010000:1.0:1790779082.080181:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603a59c00 00000100:00100000:2.0:1790779082.087110:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779082.087783:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642742272 00000100:00100000:0.0:1790779082.087794:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642742272 00000100:00100000:0.0:1790779082.087857:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:0.0:1790779082.087867:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+68:11392:x1877767642742272:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790779082.095426:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1790779082.095449:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1790779082.095486:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1790779082.095507:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b760376cc00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1790779082.095512:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b773b6bbd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b760376c600 00000020:00080000:2.0:1790779082.095515:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b773b6bbe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b76037c2800 00000004:00080000:2.0:1790779082.095540:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1790779082.095573:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7735d81d80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1790779082.095576:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b7712ab7600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7735d810c0 00000020:00080000:2.0:1790779082.095578:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b7712ab7f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b76039cda00 00000100:00100000:1.0:1790779082.098264:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663784320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790779082.098349:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779082.098428:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779082.098435:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663784192:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790779082.098456:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779082.098486:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663784320 00000100:00100000:1.0:1790779082.098508:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663784320 00000100:00100000:1.0:1790779082.098558:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663784192 00000100:00100000:1.0:1790779082.098562:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663784192 00000100:00100000:1.0:1790779082.098583:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790779082.098591:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1877767663784320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790779082.098732:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790779082.098736:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790779081 00002000:00010000:1.0:1790779082.098738:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790779082.098741:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790779081 -> 1790779081 00002000:00010000:1.0:1790779082.098743:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1790779082.098783:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3650:x1877767663784320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (435us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790779082.098791:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790779082.098811:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790779082.098818:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1877767663784192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790779082.098834:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1790779082.098852:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.098871:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f1b44bc/0xb1aa4014e936d26a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ad expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.098915:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1790779082.098920:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779082.098924:0:8438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.098985:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f1b44bc/0xb1aa4014e936d26a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ad expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.099006:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f1b44bc/0xb1aa4014e936d26a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ad expref: 11 pid: 8439 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.099019:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f50ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1877767663784448:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779082.099078:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77201636c0 going to sleep for 11 seconds 00000100:00080000:1.0:1790779082.099092:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1790779082.099123:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603008a80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790779082.099129:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663784320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790779082.100332:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11392:x1877767642742272:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 12461us (13225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779082.100344:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:2.0:1790779082.100629:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760448d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663784576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790779082.100676:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779082.101937:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663784576 00000100:00100000:0.0:1790779082.101949:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663784576 00000100:00100000:0.0:1790779082.102011:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790779082.102021:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663784576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790779082.102049:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1790779082.102079:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6abd1ec8, atime: 0x6abd1ec8, ctime: 0x6abd1ec8, blocks: 0x8 00010000:00010000:0.0:1790779082.102087:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936d4bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.102113:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1790779082.102118:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779082.102124:0:8439:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936d4bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.102140:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936d4bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790779082.102316:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790779082.102507:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936d4bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.102516:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936d4bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.102575:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790779082.102752:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3651:x1877767663784576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 733us (2075us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790779082.102760:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1790779082.102812:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760448d500/2, rc 0, transno 4294967305 00000100:00100000:0.0:1790779082.102819:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760448d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663784576:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1790779082.109985:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1790779082.110069:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1790779082.115182:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115216:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115223:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115229:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779082.115235:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115243:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115271:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b77156a9e00) 00010000:00010000:3.0:1790779082.115275:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779082.115281:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115287:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055ce400/0xb1aa4014e936d1b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115329:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115336:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115341:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115347:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cfc00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779082.115350:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115355:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115364:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b7603616100) 00010000:00010000:3.0:1790779082.115367:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779082.115370:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115376:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77055cfc00/0xb1aa4014e936d25c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115392:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115398:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115404:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115415:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779082.115419:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115424:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115432:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b771d81af00) 00010000:00010000:3.0:1790779082.115434:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779082.115437:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115443:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d2da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115455:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115460:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115466:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115471:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779082.115473:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115479:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115496:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b771d81af00) 00010000:00010000:3.0:1790779082.115498:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779082.115501:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115507:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d2fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115522:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115527:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115533:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115538:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779082.115541:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115547:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115554:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:3.0:1790779082.115556:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779082.115559:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115565:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d3cf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115583:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115589:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115595:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115600:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779082.115603:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115608:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115616:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:3.0:1790779082.115618:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790779082.115621:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.115626:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d48c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.116604:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.117954:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f50ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1877767663784448:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779082.117996:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.118177:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642742400 00000100:00100000:3.0:1790779082.118193:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642742400 00010000:00010000:3.0:1790779082.118233:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f1b44bc/0xb1aa4014e936d26a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ad expref: 12 pid: 8439 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.118585:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:3.0:1790779082.118611:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+12:2400:x1877767642742400:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779082.118627:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779082.118633:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f1b44bc/0xb1aa4014e936d26a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ad expref: 12 pid: 8439 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.118647:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f1b44bc/0xb1aa4014e936d26a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ad expref: 12 pid: 8439 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.118668:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f1b44bc/0xb1aa4014e936d26a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4258ad expref: 12 pid: 8439 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.118684:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790779082.118688:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790779082.118693:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.118703:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.118729:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779082.118782:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+11:2400:x1877767642742400:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 172us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.118789:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00010000:00010000:3.0:1790779082.118846:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.118867:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.118877:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.118906:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.119004:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779082.119031:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642742528 00000100:00100000:0.0:1790779082.119036:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642742528 00000100:00100000:0.0:1790779082.119066:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:0.0:1790779082.119073:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+11:2401:x1877767642742528:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1790779082.124614:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779082.124632:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936d4bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.124646:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779082.124652:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936d4bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.124664:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936d4bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.124711:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936d4bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.124719:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936d4bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.124749:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779082.124754:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.124760:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779082.124764:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.124772:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.124786:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.124794:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779082.124795:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779082.124797:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790779082.126742:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1790779082.126757:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1790779082.127371:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642742528:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 8292us (8361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779082.127383:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00010000:00010000:3.0:1790779082.134204:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790779082.134219:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b9fb54c/0xb1aa4014e936d4b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.134474:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1877767663784192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35653us (36013us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790779082.134484:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790779082.134842:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1790779082.134849:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1790779082.134916:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603008a80, transno 4294967310 00000100:00100000:2.0:1790779082.134934:0:3650:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9b760300b800 x1877767663784192/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790779098 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1790779082.134949:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760300b800/2, rc 0, transno 4294967311 00000100:00100000:2.0:1790779082.134954:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663784192:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1790779082.135723:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779082.135833:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779082.139388:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642742784 00000100:00100000:3.0:1790779082.139402:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642742784 00000100:00100000:3.0:1790779082.139468:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:3.0:1790779082.139480:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+16:11392:x1877767642742784:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790779082.139533:0:10428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779082.139559:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425947 expref: 16 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.139578:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:3.0:1790779082.139596:0:10428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779082.139626:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.139640:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.139650:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779082.139770:0:10428:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000013c5f03e reply state 000000005626f0e0 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.139782:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.139789:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:3.0:1790779082.139792:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790779082.139794:0:10428:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790779082.139925:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+17:11392:x1877767642742784:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 447us (4094us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1790779082.139933:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:2.0:1790779082.154742:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779082.154848:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642742912 00000100:00100000:0.0:1790779082.154859:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642742912 00000100:00100000:0.0:1790779082.154982:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:0.0:1790779082.154994:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642742912:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790779082.155145:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1790779082.155149:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1790779081 -> 1790779081 00002000:00010000:0.0:1790779082.155151:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790779080 00002000:00010000:0.0:1790779082.155594:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790779081 -> 1790779081 00002000:00010000:0.0:1790779082.155599:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1790779082.155698:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2398:x1877767642742912:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 705us (964us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1790779082.155706:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:0.0:1790779082.179535:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779082.185750:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642743168 00000100:00100000:3.0:1790779082.185769:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642743168 00000100:00100000:0.0:1790779082.185947:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:0.0:1790779082.185972:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+17:11392:x1877767642743168:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790779082.186046:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.186064:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d485 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425939 expref: 17 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.186074:0:6524:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.186361:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425939 expref: 17 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.186400:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425939 expref: 17 pid: 13003 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.186414:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760448f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1877767663784704:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779082.186525:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779082.203744:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.203903:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760448f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1877767663784704:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779082.203932:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.204115:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642743296 00000100:00100000:2.0:1790779082.204124:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642743296 00010000:00010000:2.0:1790779082.204323:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425939 expref: 18 pid: 13003 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.204360:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:2.0:1790779082.204369:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+18:2400:x1877767642743296:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779082.204383:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779082.204388:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425939 expref: 18 pid: 13003 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.204398:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425939 expref: 18 pid: 13003 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.204417:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d485 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425939 expref: 18 pid: 13003 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.204431:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:2.0:1790779082.204436:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.204445:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.204466:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.204492:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779082.204548:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+17:2400:x1877767642743296:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 180us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.204556:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 73 00010000:00010000:0.0:1790779082.204616:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.204623:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.204661:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.204669:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.204676:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.204682:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779082.204686:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.204693:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.204702:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:0.0:1790779082.204712:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790779082.204716:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.204722:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d4cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.204764:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+16:11392:x1877767642743168:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 18808us (25237us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790779082.204772:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:3.0:1790779082.207810:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779082.207866:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642743424 00000100:00100000:0.0:1790779082.207875:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642743424 00000100:00100000:0.0:1790779082.207938:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:0.0:1790779082.207947:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2398:x1877767642743424:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790779082.208005:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.208027:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.208036:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779082.208040:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790779082.208045:0:8439:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.208079:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.208122:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 7 pid: 8440 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.208137:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760448c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1877767663784832:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779082.215133:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1840 going to sleep for 11 seconds 00000100:00100000:3.0:1790779082.226640:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779082.226729:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642743552 00000100:00100000:2.0:1790779082.226738:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642743552 00010000:00010000:2.0:1790779082.226779:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 8 pid: 8440 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.226826:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:2.0:1790779082.226836:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642743552:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779082.226852:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779082.226874:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 8 pid: 8440 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.226909:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 8 pid: 8440 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.226935:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790779082.226940:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790779082.226946:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.226976:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.226997:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779082.227049:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642743552:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 214us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.227057:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 74 00010000:00010000:0.0:1790779082.227614:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936d4af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425955 expref: 7 pid: 8440 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.227632:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760448c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1877767663784832:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779082.227654:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.227665:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.227673:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.227693:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.227702:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.227723:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.227730:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779082.227735:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.227744:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.227759:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.227766:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a81c716/0xb1aa4014e936d4d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.227817:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642743424:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 19870us (20015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779082.227825:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1790779082.233265:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779082.233344:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642743808 00000100:00100000:3.0:1790779082.233354:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642743808 00000100:00100000:3.0:1790779082.233406:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:3.0:1790779082.233417:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+16:11392:x1877767642743808:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790779082.233493:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.233523:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d3c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425901 expref: 16 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.233533:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.233566:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425901 expref: 16 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.233578:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d3c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425901 expref: 16 pid: 13821 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.233591:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663784960:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779082.233671:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77119626c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779082.237219:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663784960:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779082.237252:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.239633:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.240357:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642743936 00000100:00100000:1.0:1790779082.240367:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642743936 00010000:00010000:1.0:1790779082.240405:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d3c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425901 expref: 17 pid: 13821 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.240447:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:1.0:1790779082.240469:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+17:2400:x1877767642743936:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779082.240483:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779082.240489:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d3c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425901 expref: 17 pid: 13821 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.240503:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425901 expref: 17 pid: 13821 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.240523:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d3c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425901 expref: 17 pid: 13821 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.240537:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779082.240543:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936d42a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425924 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.240554:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.240562:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.240569:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.240599:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779082.240688:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+16:2400:x1877767642743936:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 220us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.240696:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 75 00010000:00010000:3.0:1790779082.240761:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.240770:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.241003:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.241014:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d493 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425940 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.241028:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.241055:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d493 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425940 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.241069:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d493 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425940 expref: 16 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.241081:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663785088:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779082.241148:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711962300 going to sleep for 11 seconds 00000100:00100000:1.0:1790779082.248745:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779082.248838:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642744064 00000100:00100000:2.0:1790779082.248848:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642744064 00010000:00010000:2.0:1790779082.248919:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d493 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425940 expref: 17 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.248957:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:2.0:1790779082.248977:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+17:2401:x1877767642744064:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779082.248993:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779082.249000:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d493 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425940 expref: 17 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.249012:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d493 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425940 expref: 17 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.249034:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:2.0:1790779082.249039:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.249056:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.249063:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.249081:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779082.249143:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+17:2401:x1877767642744064:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 168us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.249151:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00010000:00010000:3.0:1790779082.249532:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d493 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425940 expref: 16 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.249549:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663785088:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779082.249570:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.249579:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.249585:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790779082.249695:0:6523:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1790779082.249811:0:6523:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1790779082.249847:0:6523:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1790779082.250068:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1877767663785216:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790779082.253750:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779082.257448:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b728cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779082.257488:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663785216 00000100:00100000:1.0:1790779082.257499:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663785216 00000100:00100000:1.0:1790779082.257567:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790779082.257578:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1877767663785216:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790779082.257717:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1877767663785216:12345-0@lo:1000:mdt00_000.0 Request processed in 140us (3972us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.257724:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790779082.257778:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1877767663785216:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1790779082.257982:0:6523:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1790779082.258057:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f50ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1877767663785344:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790779082.258094:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779082.258113:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760345bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779082.258124:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663785344 00000100:00100000:1.0:1790779082.258128:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663785344 00000100:00100000:1.0:1790779082.258148:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790779082.258154:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1877767663785344:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790779082.258265:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1877767663785344:12345-0@lo:1000:mdt00_000.0 Request processed in 111us (170us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1790779082.258272:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790779082.258303:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f50ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1877767663785344:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1790779082.258338:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258349:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258358:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258372:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779082.258378:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258386:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258402:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:1.0:1790779082.258405:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779082.258411:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258417:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d4e0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258440:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258446:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258451:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258456:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779082.258459:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258464:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258480:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779082.258482:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779082.258489:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936d42a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425924 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258499:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936d42a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425924 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258508:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936d42a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425924 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.258531:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936d42a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425924 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.258542:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f50d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663785472:192.168.203.3@tcp:105: 00000100:00100000:1.0:1790779082.258596:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779082.263952:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779082.264123:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642744192 00000100:00100000:3.0:1790779082.264132:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642744192 00000100:00100000:3.0:1790779082.264193:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:3.0:1790779082.264203:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+20:11391:x1877767642744192:12345-192.168.203.3@tcp:49:lfs.0 00000100:00100000:3.0:1790779082.264336:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+20:11391:x1877767642744192:12345-192.168.203.3@tcp:49:lfs.0 Request processed in 133us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.264343:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0:1790779082.264527:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f50d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663785472:192.168.203.3@tcp:105: 00010000:00010000:1.0:1790779082.264553:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264563:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d423 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264594:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d4e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264607:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d4e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264630:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d4e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264639:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d4e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264645:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d4e7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264651:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d4e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264657:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779082.264661:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d4e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264668:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d4e7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264678:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779082.264681:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779082.264684:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d4e7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264689:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d4e7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264699:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264706:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264717:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264722:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779082.264726:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264732:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264740:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779082.264742:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790779082.264745:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.264750:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d4d9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.264896:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+19:11392:x1877767642743808:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 31464us (31623us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1790779082.264905:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 139 00000020:00080000:1.0:1790779082.264909:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790779082.265349:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790779082.265355:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790779082.265372:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1790779082.265380:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790779082.273043:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779082.273261:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642744448 00000100:00100000:3.0:1790779082.273270:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642744448 00000100:00100000:3.0:1790779082.273331:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:3.0:1790779082.273341:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+19:11391:x1877767642744448:12345-192.168.203.3@tcp:58:lfs.0 00000040:00080000:3.0:1790779082.273496:0:10428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1790779082.273574:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+19:11391:x1877767642744448:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 234us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.273582:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:0.0:1790779082.277370:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779082.277476:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642744704 00000100:00100000:3.0:1790779082.277486:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642744704 00000100:00100000:3.0:1790779082.277546:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:3.0:1790779082.277557:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718265050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+19:11392:x1877767642744704:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790779082.277825:0:6526:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790779082.277873:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1790779082.277951:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d4ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.277979:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d4ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.277991:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d4ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.278000:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d4ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.278006:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d4ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.278012:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d4ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.278028:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790779082.279246:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718265050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+21:11392:x1877767642744704:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 1685us (1880us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1790779082.279267:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000020:00080000:3.0:1790779082.279274:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790779082.279505:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779082.279514:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d4ee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.279542:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779082.279546:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d4ee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.279555:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d4ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.279569:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:0.0:1790779082.279572:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790779082.279578:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d4ee lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.279584:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d4ee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.279599:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779082.279600:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779082.279602:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779082.323790:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779082.323972:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642744832 00000100:00100000:2.0:1790779082.323982:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642744832 00000100:00100000:2.0:1790779082.324042:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:2.0:1790779082.324052:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+21:11394:x1877767642744832:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779082.324075:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779082.324094:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d4f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42595c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.324528:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d4fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.324544:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d4fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.324556:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d4fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.324571:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d503 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.324595:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.324602:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.326875:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.326913:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42591d expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.326923:0:6525:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.327281:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42591d expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.327298:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42591d expref: 22 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.327313:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1877767663785600:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779082.327479:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c540 going to sleep for 11 seconds 00000100:00100000:1.0:1790779082.340869:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779082.341037:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642745088 00000100:00100000:3.0:1790779082.341048:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642745088 00000100:00100000:3.0:1790779082.341100:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:3.0:1790779082.341121:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+23:6168:x1877767642745088:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790779082.341489:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+24:6168:x1877767642745088:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 369us (627us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1790779082.341497:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:2.0:1790779082.343389:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1877767663785600:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779082.343425:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.352915:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779082.353043:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663785728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779082.353272:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779082.353367:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663785728 00000100:00100000:1.0:1790779082.353376:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663785728 00000100:00100000:1.0:1790779082.353473:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790779082.353482:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663785728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779082.353523:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1790779082.353583:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663785728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.353603:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790779082.354101:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663785728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779082.359801:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.359937:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642745216 00000100:00100000:1.0:1790779082.359947:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642745216 00010000:00010000:1.0:1790779082.359985:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42591d expref: 24 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.360023:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:1.0:1790779082.360032:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+24:2400:x1877767642745216:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779082.360046:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779082.360053:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42591d expref: 24 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.360066:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42591d expref: 24 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.360088:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d415 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42591d expref: 24 pid: 6523 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.360105:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779082.360119:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.360205:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.360214:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.360265:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779082.360332:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360342:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.360354:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+23:2400:x1877767642745216:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 322us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.360363:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 77 00000004:00200000:3.0:1790779082.360391:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790779082.360397:0:6525:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779082.360417:0:6525:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360431:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360441:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d4fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360449:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d4fc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360455:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d4fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360461:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779082.360466:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d4fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360473:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d4fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360482:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:3.0:1790779082.360485:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779082.360489:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d4fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360503:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d4fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360515:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360522:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d503 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360528:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360534:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779082.360538:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360544:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d503 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360552:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b7712a95400) 00010000:00010000:3.0:1790779082.360554:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779082.360557:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d503 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360563:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d503 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360597:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d4f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42595c expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360610:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42595c expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.360624:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:3.0:1790779082.360626:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779082.360629:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2400, rc 0) 00000100:00100000:3.0:1790779082.360655:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11394:x1877767642744832:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 36604us (36872us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.360662:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00000040:00080000:1.0:1790779082.408932:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779082.690925:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779082.946449:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.946495:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.946514:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.946534:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.946553:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.946572:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.946595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779082.946629:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642745472 00000100:00100000:1.0:1790779082.946638:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642745472 00000100:00100000:1.0:1790779082.946681:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642745600 00000100:00100000:1.0:1790779082.946684:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642745600 00000100:00100000:1.0:1790779082.946708:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642746112 00000100:00100000:1.0:1790779082.946711:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642746112 00000100:00100000:1.0:1790779082.946724:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642745984 00000100:00100000:1.0:1790779082.946727:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642745984 00000100:00100000:1.0:1790779082.946757:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:1.0:1790779082.946767:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+22:2401:x1877767642745472:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779082.946845:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+22:2401:x1877767642745472:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 79us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.946852:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:1.0:1790779082.946870:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 291 00000100:00100000:1.0:1790779082.946877:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642745600:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779082.946932:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642745600:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 56us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.946938:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 291 00000100:00100000:1.0:1790779082.946950:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 292 00000100:00100000:1.0:1790779082.946956:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642746112:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779082.946976:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642746112:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.946981:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 292 00000100:00100000:1.0:1790779082.946990:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 293 00000100:00100000:1.0:1790779082.946995:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642745984:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779082.947016:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642745984:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.947021:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 293 00000100:00100000:1.0:1790779082.947037:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642745344 00000100:00100000:2.0:1790779082.947039:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642745856 00000100:00100000:1.0:1790779082.947041:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642745344 00000100:00100000:2.0:1790779082.947042:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642745856 00000100:00100000:1.0:1790779082.947065:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 383 00000100:00100000:2.0:1790779082.947069:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642745728 00000100:00100000:2.0:1790779082.947071:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642745728 00000100:00100000:1.0:1790779082.947072:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642745344:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779082.947090:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:1.0:1790779082.947094:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642745344:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.947096:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642745856:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779082.947100:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 383 00000100:00100000:2.0:1790779082.947120:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642745856:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.947127:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:1.0:1790779082.947133:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:1.0:1790779082.947139:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642745728:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779082.947164:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642745728:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.947176:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00080000:1.0:1790779082.947211:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790779082.947216:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790779082.947218:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1790779083.304625:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790779083.304635:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790779083.304678:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790779083.304687:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790779083.304850:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a5bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663785856:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790779083.304973:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705a84480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779083.309064:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a5bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663785856:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790779083.312804:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779083.313020:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642746240 00000100:00100000:0.0:1790779083.313029:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642746240 00000100:00100000:0.0:1790779083.313090:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:0.0:1790779083.313103:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11405:x1877767642746240:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790779083.313153:0:13003:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790779083.313874:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11405:x1877767642746240:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 771us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779083.313910:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00080000:2.0:1790779083.314090:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779083.333651:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779083.333714:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642746496 00000100:00100000:1.0:1790779083.333723:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642746496 00000100:00100000:1.0:1790779083.333781:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:1.0:1790779083.333791:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+22:11405:x1877767642746496:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779083.333812:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779083.333831:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d511 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425963 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.333958:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d518 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.333972:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.333985:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779083.333997:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790779083.336282:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d511 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425963 expref: 25 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.336313:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425963 expref: 24 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.336322:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779083.336336:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779083.336340:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6e00, rc 0) 00000100:00100000:1.0:1790779083.336408:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+24:11405:x1877767642746496:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 2617us (2763us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1790779083.336416:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:0.0:1790779083.339360:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779083.339426:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642746624 00000100:00100000:3.0:1790779083.339435:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642746624 00000100:00100000:3.0:1790779083.339490:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1790779083.339499:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+24:2400:x1877767642746624:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779083.339512:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779083.339535:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d518 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425963 expref: 24 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779083.339552:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:3.0:1790779083.339556:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779083.339606:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+23:2400:x1877767642746624:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 108us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779083.339613:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1790779083.340186:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779083.340271:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642746880 00000100:00100000:0.0:1790779083.340276:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642746880 00000100:00100000:0.0:1790779083.340315:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:0.0:1790779083.340321:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+23:11405:x1877767642746880:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790779083.340382:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d526 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779083.340397:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d526 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779083.340407:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d526 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779083.340536:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d526 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779083.340543:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d526 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779083.340551:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d526 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779083.340557:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779083.340561:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d526 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779083.340580:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d526 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779083.340590:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:0.0:1790779083.340593:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790779083.340597:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d526 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779083.340604:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d526 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779083.340694:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+24:11405:x1877767642746880:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 372us (517us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1790779083.340702:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 144 00000040:00080000:0.0:1790779083.340785:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790779083.340789:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790779083.341950:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790779083.341964:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790779083.356049:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779083.356168:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642747136 00000100:00100000:2.0:1790779083.356188:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642747136 00000100:00100000:2.0:1790779083.356245:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:2.0:1790779083.356254:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+24:11405:x1877767642747136:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790779083.356483:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+25:11405:x1877767642747136:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 230us (444us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1790779083.356491:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000040:00080000:1.0:1790779083.448065:0:14315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790779083.448074:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790779083.448103:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790779083.448108:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790779083.726407:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779083.726837:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642747392 00000100:00100000:1.0:1790779083.726847:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642747392 00000100:00100000:1.0:1790779083.726920:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 145 00000100:00100000:1.0:1790779083.726930:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+25:11418:x1877767642747392:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779083.726952:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779083.726972:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d52d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42596a expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.727077:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d534 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.727093:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d534 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.727105:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d534 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779083.727116:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790779083.727367:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d52d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42596a expref: 28 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.727403:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d534 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42596a expref: 27 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.727413:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779083.727416:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790779083.727420:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7800, rc 0) 00000100:00100000:1.0:1790779083.727488:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+27:11418:x1877767642747392:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 558us (1091us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1790779083.727495:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 145 00000100:00100000:0.0:1790779083.751017:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779083.751093:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642747520 00000100:00100000:1.0:1790779083.751104:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642747520 00000100:00100000:1.0:1790779083.751166:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 146 00000100:00100000:1.0:1790779083.751186:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+27:11418:x1877767642747520:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:1.0:1790779083.751264:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d542 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.751283:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.751295:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.751332:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.751339:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d542 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.751363:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d542 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.751369:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779083.751373:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d542 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.751380:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d542 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.751392:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:1.0:1790779083.751395:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790779083.751400:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d542 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779083.751406:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d542 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779083.751479:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+27:11418:x1877767642747520:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 305us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779083.751486:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 146 00010000:00010000:1.0:1790779083.752669:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779083.882591:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760448f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663785984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779083.882671:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779083.882758:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779083.882765:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663786112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779083.882794:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779083.882927:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663785984 00000100:00100000:1.0:1790779083.882934:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663785984 00000100:00100000:1.0:1790779083.882984:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663786112 00000100:00100000:1.0:1790779083.882987:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663786112 00000100:00100000:1.0:1790779083.883003:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790779083.883011:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663785984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790779083.883039:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1790779083.883047:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790779083.883056:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1877767663786112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790779083.883065:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1790779083.883091:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663785984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779083.883095:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1877767663786112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779083.883099:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1790779083.883120:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779083.883157:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663786112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779083.883171:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760448f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663785984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779083.893070:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790779083.937460:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779083.938266:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642747648 00000100:00100000:0.0:1790779083.938281:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642747648 00000100:00100000:0.0:1790779083.938377:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:0.0:1790779083.938389:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2399:x1877767642747648:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:0.0:1790779083.938409:0:8855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779083.938432:0:8855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5ea466a/0xb1aa4014e936d549 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425971 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779083.938477:0:8855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6abd1ec9, atime: 0x6abd1ec8, ctime: 0x6abd1ec9, blocks: 0x8 00010000:00010000:0.0:1790779083.938499:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1790779083.938504:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779083.938514:0:8855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ea466a/0xb1aa4014e936d549 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425971 expref: 7 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779083.938534:0:8855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5ea466a/0xb1aa4014e936d549 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425971 expref: 7 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779083.938548:0:8855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769a00, rc 0) 00000100:00100000:0.0:1790779083.938628:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2399:x1877767642747648:12345-192.168.203.3@tcp:101:cat.0 Request processed in 241us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779083.938637:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00080000:1.0:1790779083.939589:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779083.943669:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779083.943767:0:8443:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642747776 00000100:00100000:2.0:1790779083.943778:0:8443:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642747776 00002000:00100000:2.0:1790779083.943835:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9b760448f800 x1877767642747776/t0(0) o3->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:634/0 lens 488/0 e 0 to 0 dl 1790779094 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779083.944200:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760448f800 with x1877767642747776 ext(0->4095) 00002000:00010000:2.0:1790779083.944208:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760448f800 00000100:00100000:2.0:1790779083.944235:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1790779083.944241:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1790779083.944246:0:8443:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642747776:12345-192.168.203.3@tcp:3:cat.0 00000100:00100000:0.0:1790779083.944250:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1790779083.944481:0:8443:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642747776:12345-192.168.203.3@tcp:3:cat.0 Request processed in 235us (834us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790779083.944489:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00002000:00100000:2.0:1790779083.944497:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9b760448f800 x1877767642747776/t0(0) o3->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:634/0 lens 488/4536 e 0 to 0 dl 1790779094 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779083.944506:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760448f800 with x1877767642747776 ext(0->4095) 00002000:00010000:2.0:1790779083.944510:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760448f800 00010000:00010000:0.0:1790779084.777371:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779084.905456:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663786368:0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.905492:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663786624:0@lo:400:kworker.0 00000100:00100000:3.0:1790779084.905527:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779084.905551:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663786368 00000100:00100000:2.0:1790779084.905558:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663786368 00000100:00100000:3.0:1790779084.905594:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1877767663786880:0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.905601:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1790779084.905611:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663786368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779084.905630:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779084.905658:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663786368:12345-0@lo:400:kworker.0 Request processed in 49us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779084.905661:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663787392:0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.905680:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1790779084.905682:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779084.905697:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663786880 00000100:00100000:2.0:1790779084.905712:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663786880 00000100:00100000:3.0:1790779084.905715:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663786368:0@lo:400:kworker.0 00000100:00100000:3.0:1790779084.905730:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1790779084.905734:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1790779084.905736:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663786240:0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.905739:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1877767663786880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779084.905765:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779084.905895:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663786496:0@lo:400:kworker.0 00000100:00100000:0.0:1790779084.905941:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779084.905951:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663787904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779084.910333:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1877767663786880:12345-0@lo:400:kworker.0 Request processed in 4583us (4691us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779084.910348:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1790779084.910382:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663787392 00000100:00100000:2.0:1790779084.910391:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663787392 00000100:00100000:2.0:1790779084.910448:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1790779084.910456:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663787392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.910514:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663787392:12345-0@lo:400:kworker.0 Request processed in 58us (4830us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779084.910520:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1790779084.910573:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779084.910612:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663787136:0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.910646:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779084.910674:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663787648:0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.910695:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779084.910747:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663786624 00000100:00100000:2.0:1790779084.910752:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663786624 00000100:00100000:2.0:1790779084.910773:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1790779084.910779:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663786624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.910814:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663786624:12345-0@lo:400:kworker.0 Request processed in 35us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779084.910838:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1790779084.910857:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663787136 00000100:00100000:2.0:1790779084.910861:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663787136 00000100:00100000:2.0:1790779084.910910:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663787648 00000100:00100000:2.0:1790779084.910914:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663787648 00000100:00100000:2.0:1790779084.910937:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790779084.910943:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663787136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.910978:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663787136:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779084.910984:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790779084.910996:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790779084.911000:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663787648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.911030:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663787648:12345-0@lo:400:kworker.0 Request processed in 29us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779084.911035:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790779084.911072:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663786624:0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.911082:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663787136:0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.911090:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663787648:0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.911148:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663786240 00000100:00100000:2.0:1790779084.911151:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663786240 00000100:00100000:2.0:1790779084.911187:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1790779084.911194:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663786240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.911226:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663786240:12345-0@lo:400:kworker.0 Request processed in 33us (5460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779084.911233:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:2.0:1790779084.911271:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790779084.911277:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779084.911339:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779084.911347:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663788032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779084.911371:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779084.911403:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663788032 00000100:00100000:2.0:1790779084.911406:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663788032 00000100:00100000:2.0:1790779084.911434:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790779084.911440:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877767663788032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790779084.911461:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779084.911494:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877767663788032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779084.911500:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1790779084.911513:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779084.911534:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663788032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779084.916053:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663786240:0@lo:400:kworker.0 00000100:00100000:3.0:1790779084.916071:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663786752:0@lo:400:kworker.0 00000100:00100000:3.0:1790779084.916130:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779084.918323:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663787264:0@lo:400:kworker.0 00000100:00100000:3.0:1790779084.918385:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779084.918425:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663787264 00000100:00100000:3.0:1790779084.918432:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663787264 00000100:00100000:3.0:1790779084.918490:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790779084.918511:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1877767663787264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779084.918561:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1877767663787264:12345-0@lo:400:kworker.0 Request processed in 63us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779084.918584:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1790779084.918605:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779084.918610:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779084.918633:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663786752 00000100:00100000:3.0:1790779084.918635:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663787264:0@lo:400:kworker.0 00000100:00100000:1.0:1790779084.918637:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663786752 00000100:00100000:3.0:1790779084.918642:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663787776:0@lo:400:kworker.0 00000100:00100000:1.0:1790779084.918656:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663786496 00000100:00100000:1.0:1790779084.918659:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663786496 00000100:00100000:1.0:1790779084.918670:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790779084.918676:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663786752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779084.918724:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663786752:12345-0@lo:400:kworker.0 Request processed in 48us (2594us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779084.918731:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790779084.918743:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790779084.918749:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663786496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779084.918776:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663786496:12345-0@lo:400:kworker.0 Request processed in 27us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779084.918781:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790779084.918807:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663786496:0@lo:400:kworker.0 00000100:00100000:1.0:1790779084.918813:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663787008:0@lo:400:kworker.0 00000100:00100000:1.0:1790779084.918849:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779084.918892:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663787520:0@lo:400:kworker.0 00000100:00100000:1.0:1790779084.918915:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779084.918936:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663787008 00000100:00100000:1.0:1790779084.918940:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663787008 00000100:00100000:1.0:1790779084.918973:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663787520 00000100:00100000:1.0:1790779084.918976:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663787520 00000100:00100000:1.0:1790779084.918996:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1790779084.919001:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663787008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779084.919032:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663787008:12345-0@lo:400:kworker.0 Request processed in 31us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779084.919037:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1790779084.919049:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1790779084.919054:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663787520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779084.919079:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663787520:12345-0@lo:400:kworker.0 Request processed in 25us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779084.919084:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00010000:00080000:1.0:1790779084.919115:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7f5880 x1877767663787520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779084.919125:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663787520:0@lo:400:kworker.0 00010000:00080000:1.0:1790779084.919151:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603967800 x1877767663787008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779084.919158:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663787008:0@lo:400:kworker.0 00000100:00080000:2.0:1790779084.919301:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790779084.919948:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779084.920031:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1877767663786880:0@lo:400:kworker.0 00000100:00100000:3.0:1790779084.920043:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663787392:0@lo:400:kworker.0 00000100:00100000:3.0:1790779084.920068:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663786752:0@lo:400:kworker.0 00000100:00100000:0.0:1790779084.924387:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779084.925615:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663787904 00000100:00100000:3.0:1790779084.925626:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663787904 00000100:00100000:3.0:1790779084.925689:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790779084.925699:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663787904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779084.925723:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779084.925783:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663787904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779084.925790:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790779084.925916:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663787904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779084.931808:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663787776 00000100:00100000:2.0:1790779084.931830:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663787776 00000100:00100000:2.0:1790779084.931915:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790779084.931925:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76039b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1877767663787776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779084.932021:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76039b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1877767663787776:12345-0@lo:400:kworker.0 Request processed in 98us (12074us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779084.932028:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790779084.933043:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663787776:0@lo:400:kworker.0 00000100:00100000:2.0:1790779085.417541:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663788160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779085.417609:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779085.417693:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663788160 00000100:00100000:2.0:1790779085.417701:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663788160 00000100:00100000:2.0:1790779085.417752:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790779085.417761:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663788160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790779085.417794:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790779085.417838:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663788160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779085.417845:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790779085.417916:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663788160:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790779085.801049:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779086.827709:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790779086.961593:0:9517:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1790779086.961619:0:9517:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1790779087.470250:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779087.470281:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663788288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779087.470378:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779087.471403:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663788288 00000100:00100000:2.0:1790779087.471413:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663788288 00000100:00100000:2.0:1790779087.471475:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790779087.471484:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663788288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779087.471518:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1790779087.471575:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663788288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779087.471582:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790779087.471634:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663788288:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790779087.848018:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790779087.984711:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1790779087.984776:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7720163300 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1790779087.984784:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b7712ab7c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b77201636c0 00000020:00080000:2.0:1790779087.984788:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b7712ab7b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b76037c3400 00000020:00080000:2.0:1790779087.984818:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1790779087.984945:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1790779087.985056:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1790779087.985214:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779087.985229:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779087.985344:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779087.985351:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779087.985357:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779087.985368:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779087.985389:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b7712a95800) 00010000:00010000:3.0:1790779087.985393:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779087.985400:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779087.985407:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d4c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779087.986244:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1790779087.986854:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:3.0:1790779088.052217:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779088.052285:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779088.052331:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779088.052380:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779088.052403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779088.052423:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779088.052452:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779088.052490:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642748288 00000100:00100000:3.0:1790779088.052503:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642748288 00000100:00100000:3.0:1790779088.052574:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642748416 00000100:00100000:3.0:1790779088.052578:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642748416 00000100:00100000:3.0:1790779088.052607:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:3.0:1790779088.052637:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642748288:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779088.052728:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642748288:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 95us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779088.053177:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642748032 00000100:00100000:1.0:1790779088.053183:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642748032 00000100:00100000:1.0:1790779088.053227:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642748544 00000100:00100000:1.0:1790779088.053231:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642748544 00000100:00100000:1.0:1790779088.053256:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642748160 00000100:00100000:1.0:1790779088.053259:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642748160 00000100:00100000:1.0:1790779088.053272:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642748672 00000100:00100000:1.0:1790779088.053275:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642748672 00000100:00100000:1.0:1790779088.053291:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 300 00000100:00100000:1.0:1790779088.053299:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7708945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+13:2398:x1877767642748032:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779088.053341:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7708945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+13:2398:x1877767642748032:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 44us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779088.053348:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 300 00000100:00100000:1.0:1790779088.053368:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 301 00000100:00100000:1.0:1790779088.053375:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642748544:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779088.053400:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642748544:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779088.053406:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 301 00000100:00100000:1.0:1790779088.053417:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 302 00000100:00100000:1.0:1790779088.053423:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642748160:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779088.053447:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642748160:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779088.053454:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 302 00000100:00100000:1.0:1790779088.053466:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 303 00000100:00100000:1.0:1790779088.053483:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642748672:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779088.053510:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642748672:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779088.053515:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 303 00000100:00100000:1.0:1790779088.053538:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642747904 00000100:00100000:1.0:1790779088.053541:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642747904 00000100:00100000:1.0:1790779088.053570:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 385 00000100:00100000:1.0:1790779088.053576:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2398:x1877767642747904:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779088.053600:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2398:x1877767642747904:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779088.053607:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 385 00000100:00080000:2.0:1790779088.053915:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779088.053921:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779088.053924:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790779088.053927:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779088.054077:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:0.0:1790779088.057301:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:0.0:1790779088.057603:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642748416:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779088.057737:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642748416:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 151us (5312us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779088.057746:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 120 00010000:00010000:2.0:1790779088.872289:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779089.004350:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663788416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779089.004452:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779089.004553:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663788416 00000100:00100000:2.0:1790779089.004562:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663788416 00000100:00100000:2.0:1790779089.004634:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790779089.004644:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663788416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790779089.004685:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1790779089.004741:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663788416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779089.004749:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1790779089.004775:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779089.004814:0:3652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1790779089.004820:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760300b800, transno 4294967311 00000004:00080000:2.0:1790779089.004834:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1790779089.004875:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663788416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779089.010668:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790779089.010698:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663788544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779089.010787:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779089.010857:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663788544 00000100:00100000:0.0:1790779089.010867:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663788544 00000100:00100000:0.0:1790779089.011036:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790779089.011049:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663788544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779089.011080:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1790779089.012514:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663788544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1058us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779089.012530:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790779089.012618:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663788544:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790779089.012650:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790779089.897966:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779089.979270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779089.980814:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642748800 00000100:00100000:1.0:1790779089.980833:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642748800 00000100:00100000:1.0:1790779089.980966:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:1.0:1790779089.980978:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+13:11071:x1877767642748800:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790779089.981148:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+13:11071:x1877767642748800:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 172us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779089.981157:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:3.0:1790779089.984294:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779089.984504:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642748928 00000100:00100000:1.0:1790779089.984518:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642748928 00000100:00100000:1.0:1790779089.984660:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:1.0:1790779089.984672:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:11071:x1877767642748928:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790779089.984827:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:11071:x1877767642748928:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 157us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779089.984862:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:0.0:1790779089.998529:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779089.998815:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642749184 00000100:00100000:1.0:1790779089.998830:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642749184 00000100:00100000:1.0:1790779089.999000:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:1.0:1790779089.999013:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+13:11071:x1877767642749184:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790779089.999375:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+14:11071:x1877767642749184:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 364us (862us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1790779089.999384:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:0.0:1790779090.025753:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663788672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779090.025854:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779090.027350:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663788672 00000100:00100000:2.0:1790779090.027370:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663788672 00000100:00100000:2.0:1790779090.027452:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790779090.027465:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663788672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790779090.027506:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779090.027593:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663788672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779090.027601:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1790779090.027629:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779090.027681:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663788672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779090.027815:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779090.027829:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663788800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779090.027870:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779090.027931:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663788800 00000100:00100000:3.0:1790779090.027934:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663788800 00000100:00100000:3.0:1790779090.027962:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790779090.027966:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663788800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790779090.027975:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779090.027998:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663788800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779090.028002:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1790779090.028013:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779090.028024:0:3652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1790779090.028028:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1790779090.028045:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760448d500, transno 4294967305 00000100:00100000:3.0:1790779090.028057:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663788800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790779090.028988:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663789056:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.029053:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779090.029070:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663788928:0@lo:400:kworker.0 00000100:00100000:3.0:1790779090.029106:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779090.029107:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663789568:0@lo:400:kworker.0 00000100:00100000:3.0:1790779090.029141:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663789440:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.029142:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779090.029158:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663790080:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.029177:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779090.029188:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779090.029196:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790779090.029201:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663789184:0@lo:400:kworker.0 00000100:00100000:3.0:1790779090.029203:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663789952:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.029221:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779090.029223:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779090.029234:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663789696:0@lo:400:kworker.0 00000100:00100000:3.0:1790779090.029238:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790779090.029243:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663789312:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.029253:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779090.029268:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663789952 00000100:00100000:1.0:1790779090.029271:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663790208:0@lo:400:kworker.0 00000100:00100000:3.0:1790779090.029274:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663789952 00000100:00100000:1.0:1790779090.029304:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779090.029311:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790779090.029320:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663789952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.029328:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779090.029343:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663789824:0@lo:400:kworker.0 00000100:00100000:3.0:1790779090.029364:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663789952:12345-0@lo:400:kworker.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779090.029370:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790779090.029372:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779090.029384:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663789824 00000100:00100000:3.0:1790779090.029387:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663789824 00000100:00100000:1.0:1790779090.029400:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663789952:0@lo:400:kworker.0 00000100:00100000:3.0:1790779090.029405:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790779090.029410:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663789824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.029427:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663789056 00000100:00100000:1.0:1790779090.029430:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663789056 00000100:00100000:3.0:1790779090.029443:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663789824:12345-0@lo:400:kworker.0 Request processed in 33us (70us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779090.029449:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790779090.029455:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663789568 00000100:00100000:1.0:1790779090.029457:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663789568 00000100:00100000:1.0:1790779090.029483:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663790080 00000100:00100000:1.0:1790779090.029486:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663790080 00000100:00100000:3.0:1790779090.029487:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663789696 00000100:00100000:3.0:1790779090.029489:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663789696 00000100:00100000:1.0:1790779090.029498:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663790208 00000100:00100000:1.0:1790779090.029500:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663790208 00000100:00100000:3.0:1790779090.029505:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663789312 00000100:00100000:3.0:1790779090.029507:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663789312 00000100:00100000:1.0:1790779090.029512:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1790779090.029518:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663789056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779090.029520:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1790779090.029525:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663789568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.029564:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663789056:12345-0@lo:400:kworker.0 Request processed in 35us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779090.029571:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1790779090.029585:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1790779090.029591:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663790080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779090.029605:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663788928 00000100:00100000:2.0:1790779090.029615:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663788928 00000100:00100000:2.0:1790779090.029691:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1790779090.029699:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663788928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779090.029734:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663788928:12345-0@lo:400:kworker.0 Request processed in 37us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779090.029740:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1790779090.029772:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1790779090.029779:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663789696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.031768:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663790080:12345-0@lo:400:kworker.0 Request processed in 2164us (2576us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779090.031786:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1790779090.033856:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663789568:12345-0@lo:400:kworker.0 Request processed in 4317us (4699us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779090.033926:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1790779090.033973:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1790779090.033989:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663790208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779090.034090:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663790208:12345-0@lo:400:kworker.0 Request processed in 110us (4785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779090.034096:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1790779090.034110:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1790779090.034118:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663789312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779090.034169:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663789312:12345-0@lo:400:kworker.0 Request processed in 52us (4839us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779090.034175:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:3.0:1790779090.034208:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779090.034214:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779090.035171:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663789696:12345-0@lo:400:kworker.0 Request processed in 5383us (5907us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779090.035182:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1790779090.035255:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663789440 00000100:00100000:2.0:1790779090.035266:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663789440 00000100:00100000:2.0:1790779090.035306:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663789184 00000100:00100000:2.0:1790779090.035309:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663789184 00000100:00100000:2.0:1790779090.035325:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790779090.035332:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663789440:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790779090.035348:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041aca80 x1877767663789696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779090.035368:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663789696:0@lo:400:kworker.0 00010000:00080000:1.0:1790779090.035387:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77108a5500 x1877767663790208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779090.035395:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663790208:0@lo:400:kworker.0 00000100:00100000:2.0:1790779090.035397:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663789440:12345-0@lo:400:kworker.0 Request processed in 66us (6208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779090.035403:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790779090.035416:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790779090.035421:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663789184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.035427:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663789568:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.035440:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663790080:0@lo:400:kworker.0 00000100:00100000:2.0:1790779090.035447:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663789184:12345-0@lo:400:kworker.0 Request processed in 26us (6226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779090.035452:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1790779090.035453:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663789056:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.035489:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663789184:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.035523:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663789312:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.035536:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663789824:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.035547:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663788928:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.035729:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663789440:0@lo:400:kworker.0 00000100:00100000:1.0:1790779090.536410:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779090.536446:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663790336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779090.536558:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779090.536752:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663790336 00000100:00100000:0.0:1790779090.536763:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663790336 00000100:00100000:0.0:1790779090.536839:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790779090.536851:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663790336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779090.536926:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790779090.537019:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663790336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779090.537027:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790779090.537532:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663790336:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790779090.920157:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779091.951520:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790779092.235385:0:14514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:38:10 (1790779090) 00000040:00080000:2.0:1790779092.584052:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790779092.584062:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790779092.584179:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1790779092.584189:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790779092.584538:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779092.584558:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663790464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779092.584629:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779092.584912:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663790464 00000100:00100000:0.0:1790779092.584920:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663790464 00000100:00100000:0.0:1790779092.584968:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790779092.584977:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663790464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779092.585010:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1790779092.585081:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663790464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779092.585088:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790779092.585410:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663790464:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1790779092.650720:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790779092.968297:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779093.184442:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779093.184488:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779093.184517:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779093.184539:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779093.184556:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779093.184569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779093.184600:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779093.184641:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642749824 00000100:00100000:3.0:1790779093.184651:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642749824 00000100:00100000:3.0:1790779093.184702:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642749696 00000100:00100000:3.0:1790779093.184706:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642749696 00000100:00100000:3.0:1790779093.184727:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:3.0:1790779093.184736:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642749824:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779093.184804:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642749824:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 69us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779093.184813:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:3.0:1790779093.184829:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:3.0:1790779093.184836:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642749696:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779093.184858:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642749696:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779093.184863:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:3.0:1790779093.184930:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642749568 00000100:00100000:3.0:1790779093.184934:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642749568 00000100:00100000:3.0:1790779093.184957:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642750080 00000100:00100000:3.0:1790779093.184958:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642750080 00000100:00100000:3.0:1790779093.184972:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642749440 00000100:00100000:3.0:1790779093.184974:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642749440 00000100:00100000:3.0:1790779093.185163:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642749952 00000100:00100000:3.0:1790779093.185167:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642749952 00000100:00100000:3.0:1790779093.185182:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 310 00000100:00100000:3.0:1790779093.185188:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642749568:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779093.185215:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642749568:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779093.185221:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 310 00000100:00100000:3.0:1790779093.185239:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 311 00000100:00100000:3.0:1790779093.185245:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642750080:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779093.185268:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642750080:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779093.185273:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 311 00000100:00100000:3.0:1790779093.185282:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 312 00000100:00100000:3.0:1790779093.185287:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+14:2401:x1877767642749440:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779093.185308:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+14:2401:x1877767642749440:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779093.185314:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 312 00000100:00100000:3.0:1790779093.185323:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 313 00000100:00100000:3.0:1790779093.185329:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642749952:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779093.185349:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642749952:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779093.185354:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 313 00000100:00080000:3.0:1790779093.185374:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790779093.185377:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779093.185379:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790779093.185381:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779093.185478:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642749312 00000100:00100000:2.0:1790779093.185482:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642749312 00000100:00100000:2.0:1790779093.185517:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 387 00000100:00100000:2.0:1790779093.185524:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642749312:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779093.185547:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642749312:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 24us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779093.185553:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 387 00000100:00100000:0.0:1790779093.769152:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779093.769773:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642750336 00000100:00100000:3.0:1790779093.769783:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642750336 00000100:00100000:3.0:1790779093.769856:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:3.0:1790779093.769866:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+14:12136:x1877767642750336:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779093.769919:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779093.769942:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d550 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425978 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770035:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d557 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770051:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d557 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770077:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d557 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770094:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d55e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770109:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d55e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770117:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d55e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770216:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d565 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770225:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770231:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779093.770262:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1790779093.770350:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d557 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770369:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d557 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770377:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d557 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770383:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779093.770388:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d557 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770397:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d557 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770409:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b7603615200) 00010000:00010000:3.0:1790779093.770412:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779093.770418:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d557 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.770996:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d557 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.771016:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d55e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.771022:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d55e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.771029:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d55e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.771035:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779093.771045:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d55e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.771052:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d55e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.771062:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b7703991600) 00010000:00010000:3.0:1790779093.771065:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779093.771068:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d55e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.771087:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d55e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.776832:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d550 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425978 expref: 17 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.776860:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d565 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425978 expref: 16 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779093.776869:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:3.0:1790779093.776872:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779093.776875:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663000, rc 0) 00000100:00100000:3.0:1790779093.776969:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+16:12136:x1877767642750336:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 7104us (7826us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1790779093.776977:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 149 00000001:00080000:1.0:1790779093.778445:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:1.0:1790779093.778463:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1790779093.778578:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1790779093.778589:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1790779093.782562:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779093.782784:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642750464 00000100:00100000:2.0:1790779093.782796:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642750464 00000100:00100000:2.0:1790779093.782865:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:2.0:1790779093.782874:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+14:2400:x1877767642750464:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779093.782907:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779093.782932:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d565 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425978 expref: 14 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779093.782950:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:2.0:1790779093.782955:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779093.783007:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+13:2400:x1877767642750464:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 134us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779093.783015:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1790779093.783496:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779093.784544:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642750592 00000100:00100000:2.0:1790779093.784555:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642750592 00000100:00100000:2.0:1790779093.784600:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:2.0:1790779093.784609:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+13:12136:x1877767642750592:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790779093.784724:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+13:12136:x1877767642750592:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 116us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779093.784731:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:2.0:1790779093.788047:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779093.788359:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642750720 00000100:00100000:1.0:1790779093.788370:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642750720 00000100:00100000:1.0:1790779093.788441:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:1.0:1790779093.788452:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:12136:x1877767642750720:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790779093.788559:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:12136:x1877767642750720:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 109us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779093.788583:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 151 00010000:00010000:1.0:1790779093.992698:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779094.120241:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663790592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779094.120367:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779094.120529:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663790592 00000100:00100000:2.0:1790779094.120538:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663790592 00000100:00100000:0.0:1790779094.120813:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779094.120826:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663790720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779094.120870:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779094.120953:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663790720 00000100:00100000:0.0:1790779094.120959:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663790720 00000100:00100000:0.0:1790779094.121042:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790779094.121055:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663790720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779094.121116:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1790779094.121173:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663790720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779094.121182:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790779094.121201:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663790720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779094.121595:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790779094.121605:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663790592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790779094.121618:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1790779094.121903:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663790592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 299us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779094.121912:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1790779094.121935:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779094.122291:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663790592:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1790779094.635349:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790779094.635361:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790779094.635383:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1790779094.635404:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1790779094.703424:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779095.019234:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779095.146716:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779095.146755:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663790848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779095.146854:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779095.146965:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663790848 00000100:00100000:2.0:1790779095.146975:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663790848 00000100:00100000:2.0:1790779095.147434:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790779095.147448:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663790848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790779095.147493:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779095.147505:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779095.147518:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663790976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779095.147561:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663790848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779095.147579:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790779095.147581:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779095.147636:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663790976 00000100:00100000:3.0:1790779095.147641:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663790976 00000100:00100000:3.0:1790779095.147677:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790779095.147683:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663790976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779095.147694:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779095.147727:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663790976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779095.147734:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1790779095.147766:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779095.147790:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663790848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779095.147833:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663790976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779095.153321:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663791488:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.153456:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663791104:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.153535:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779095.153604:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663791616:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.153636:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779095.153664:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663792128:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.153688:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779095.153719:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790779095.153726:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663791232:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.153752:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779095.153771:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663791744:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.153793:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779095.153811:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663792256:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.153831:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779095.153864:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663791104 00000100:00100000:1.0:1790779095.153874:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663791104 00000100:00100000:1.0:1790779095.153956:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1790779095.153967:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663791104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154042:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3649:x1877767663791104:12345-0@lo:400:kworker.0 Request processed in 75us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779095.154062:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1790779095.154129:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663791104:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154180:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663791616 00000100:00100000:1.0:1790779095.154185:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663791616 00000100:00100000:1.0:1790779095.154211:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790779095.154217:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663791616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154262:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663791616:12345-0@lo:400:kworker.0 Request processed in 44us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779095.154269:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790779095.154294:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663791616:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154318:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663791232 00000100:00100000:1.0:1790779095.154322:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663791232 00000100:00100000:1.0:1790779095.154350:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663791744 00000100:00100000:1.0:1790779095.154353:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663791744 00000100:00100000:1.0:1790779095.154392:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663792256 00000100:00100000:1.0:1790779095.154395:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663792256 00000100:00100000:1.0:1790779095.154412:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1790779095.154418:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663791232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154453:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663791232:12345-0@lo:400:kworker.0 Request processed in 35us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779095.154460:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1790779095.154471:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1790779095.154477:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663791744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154504:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663791744:12345-0@lo:400:kworker.0 Request processed in 28us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779095.154509:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1790779095.154529:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1790779095.154535:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663792256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154564:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663792256:12345-0@lo:400:kworker.0 Request processed in 29us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779095.154570:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:1.0:1790779095.154590:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779095.154608:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663791232:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154618:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663791744:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154628:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663792256:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154674:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663791360:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154704:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779095.154722:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663791872:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154743:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779095.154756:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663792384:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154776:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779095.154802:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663791872 00000100:00100000:1.0:1790779095.154806:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663791872 00000100:00100000:1.0:1790779095.154830:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663792384 00000100:00100000:1.0:1790779095.154833:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663792384 00000100:00100000:1.0:1790779095.154847:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1790779095.154853:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663791872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154918:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663791872:12345-0@lo:400:kworker.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779095.154924:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1790779095.154936:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1790779095.154948:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663792384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.154976:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663792384:12345-0@lo:400:kworker.0 Request processed in 28us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779095.154982:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:1.0:1790779095.154997:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779095.155004:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663791360 00000100:00100000:1.0:1790779095.155008:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663791360 00000100:00100000:1.0:1790779095.155025:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790779095.155030:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663791360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.155058:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663791360:12345-0@lo:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779095.155063:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790779095.155101:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663791360:0@lo:400:kworker.0 00010000:00080000:1.0:1790779095.155116:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046a7100 x1877767663791872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779095.155127:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663791872:0@lo:400:kworker.0 00010000:00080000:1.0:1790779095.155137:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046a6680 x1877767663792384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779095.155146:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663792384:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.155180:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663792128 00000100:00100000:1.0:1790779095.155184:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663792128 00000100:00100000:1.0:1790779095.155214:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790779095.155221:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663792128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.155257:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663792128:12345-0@lo:400:kworker.0 Request processed in 37us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779095.155272:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790779095.155300:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663792128:0@lo:400:kworker.0 00000100:00100000:3.0:1790779095.156503:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779095.156561:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663792000:0@lo:400:kworker.0 00000100:00100000:3.0:1790779095.156712:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779095.156819:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663792000 00000100:00100000:2.0:1790779095.156827:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663792000 00000100:00100000:2.0:1790779095.156916:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790779095.156928:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663792000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779095.157008:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663792000:12345-0@lo:400:kworker.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779095.157015:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790779095.158790:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663792000:0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.160186:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663791488 00000100:00100000:1.0:1790779095.160205:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663791488 00000100:00100000:1.0:1790779095.160686:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1790779095.160700:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663791488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779095.160837:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663791488:12345-0@lo:400:kworker.0 Request processed in 140us (4339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779095.160846:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1790779095.160958:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663791488:0@lo:400:kworker.0 00000100:00100000:0.0:1790779095.657044:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663792512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779095.657125:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779095.657321:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663792512 00000100:00100000:1.0:1790779095.657329:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663792512 00000100:00100000:1.0:1790779095.658019:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790779095.658033:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663792512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790779095.658070:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790779095.663479:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663792512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5441us (6343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779095.663495:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790779095.671205:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663792512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779095.923739:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779095.924339:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642750848 00000100:00100000:2.0:1790779095.924360:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642750848 00000100:00100000:2.0:1790779095.924435:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:2.0:1790779095.924446:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+13:12179:x1877767642750848:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779095.924466:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779095.924485:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d573 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42597f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924551:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d57a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924568:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d57a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924579:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d57a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924593:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d581 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924601:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924621:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924665:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d57a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924673:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d57a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924679:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d57a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924685:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779095.924690:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d57a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924698:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d57a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924710:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603618200) 00010000:00010000:2.0:1790779095.924713:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779095.924718:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d57a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924724:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d57a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924736:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924743:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d581 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924756:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d581 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924761:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779095.924764:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d581 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924771:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d581 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924780:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b7712a96c00) 00010000:00010000:2.0:1790779095.924783:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779095.924785:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d581 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924791:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d581 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924823:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d573 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42597f expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924834:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603618200) 00010000:00010000:2.0:1790779095.924837:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779095.924840:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d573 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42597f expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.924864:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3800, rc 0) 00000100:00100000:2.0:1790779095.924956:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+13:12179:x1877767642750848:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 511us (1226us total) trans 0 rc 301/301 00000100:00100000:2.0:1790779095.924973:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00080000:0.0:1790779095.925494:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779095.939596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779095.939675:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642751104 00000100:00100000:2.0:1790779095.939685:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642751104 00000100:00100000:2.0:1790779095.939752:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 153 00000100:00100000:2.0:1790779095.939763:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+13:12179:x1877767642751104:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:2.0:1790779095.939819:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779095.939844:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936ced5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257aa expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.939861:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603618200) 00010000:00010000:2.0:1790779095.939873:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779095.939959:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d588 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.939973:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d588 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.939982:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d588 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.939993:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940000:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940006:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940541:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940558:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940566:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779095.940583:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ad481f24 reply state 000000008ed110a5 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940594:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940599:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:2.0:1790779095.940602:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779095.940604:0:6524:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790779095.940609:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790779095.940615:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d588 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940622:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d588 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940629:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d588 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940634:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779095.940638:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d588 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940645:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d588 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940664:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a96c00) 00010000:00010000:2.0:1790779095.940666:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779095.940670:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d588 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940676:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d588 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779095.940689:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ad481f24 reply state 000000008ed110a5 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940697:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779095.940702:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b7712a96800) 00010000:00010000:2.0:1790779095.940704:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779095.940706:0:6524:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790779095.940785:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+14:12179:x1877767642751104:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 1023us (1196us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1790779095.940793:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 153 00010000:00010000:1.0:1790779096.045608:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779096.121383:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779096.121537:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642751232 00000100:00100000:1.0:1790779096.121548:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642751232 00000100:00100000:1.0:1790779096.121645:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 154 00000100:00100000:1.0:1790779096.121655:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+14:12187:x1877767642751232:12345-192.168.203.3@tcp:101:lctl.0 00010000:00010000:1.0:1790779096.121677:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779096.121695:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d59d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425986 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.121788:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d5a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.121799:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.121807:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779096.121848:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790779096.121852:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779096.121874:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.121954:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d59d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425986 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.121973:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425986 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.121981:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b76026e7b00) 00010000:00010000:1.0:1790779096.121984:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790779096.121988:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7600, rc 0) 00000100:00100000:1.0:1790779096.122054:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+15:12187:x1877767642751232:12345-192.168.203.3@tcp:101:lctl.0 Request processed in 401us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779096.122062:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 154 00000100:00100000:0.0:1790779096.197907:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779096.198066:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642751360 00000100:00100000:2.0:1790779096.198078:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642751360 00000100:00100000:2.0:1790779096.198149:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 155 00000100:00100000:2.0:1790779096.198160:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+15:12193:x1877767642751360:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1790779096.198182:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779096.198207:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d5ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42598d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.198304:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d5b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.198320:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d5b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.198330:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d5b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.198341:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d5b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.198348:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.198354:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.198433:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d5c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.198441:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.200842:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779096.200930:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790779096.200934:0:6525:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779096.200958:0:6525:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.200997:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d5b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201004:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d5b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201013:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d5b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201019:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779096.201024:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d5b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201031:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d5b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201044:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b76026e7b00) 00010000:00010000:2.0:1790779096.201047:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779096.201298:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d5b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201398:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936d5b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201418:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201424:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d5b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201429:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d5b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201443:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779096.201511:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d5b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201520:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d5b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201530:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b7712a96800) 00010000:00010000:2.0:1790779096.201533:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779096.201536:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d5b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201542:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936d5b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201584:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936d5ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42598d expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201597:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42598d expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.201603:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:2.0:1790779096.201605:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790779096.201608:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3a00, rc 0) 00000100:00100000:2.0:1790779096.201760:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+16:12193:x1877767642751360:12345-192.168.203.3@tcp:101:bash.0 Request processed in 3602us (3891us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779096.201769:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 155 00000100:00100000:3.0:1790779096.205800:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779096.205942:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642751616 00000100:00100000:2.0:1790779096.205972:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642751616 00000100:00100000:2.0:1790779096.206038:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 156 00000100:00100000:2.0:1790779096.206048:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+16:12193:x1877767642751616:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1790779096.206090:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779096.206112:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d5c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425994 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.206283:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936d5ce lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.206300:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936d5ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.206314:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936d5ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.206371:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.206379:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.206386:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790779096.206971:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1790779096.207120:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d5dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.207132:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d5dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.207156:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d5dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.207190:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936d5ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.207198:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936d5ce lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.207205:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936d5ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.207212:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779096.207216:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936d5ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.207225:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936d5ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.207237:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:2.0:1790779096.207240:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779096.207245:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936d5ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.207251:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936d5ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779096.207514:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c0caf715 reply state 00000000a34fa705 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.207528:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.207542:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7712a96c00) 00010000:00010000:2.0:1790779096.207544:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779096.207547:0:6524:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790779096.207589:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936d5c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425994 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.210690:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d5dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425994 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.210810:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:2.0:1790779096.210814:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779096.210818:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b800, rc 0) 00000100:00100000:2.0:1790779096.210943:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+19:12193:x1877767642751616:12345-192.168.203.3@tcp:101:bash.0 Request processed in 4894us (5153us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1790779096.210952:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 156 00000100:00100000:0.0:1790779096.219053:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779096.228350:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642751744 00000100:00100000:1.0:1790779096.228373:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642751744 00000100:00100000:1.0:1790779096.228479:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:1.0:1790779096.228492:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642751744:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1790779096.228510:0:8855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779096.228531:0:8855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dfcc8d6/0xb1aa4014e936d5ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b42599b expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790779096.228557:0:8855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790779096.228576:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1790779096.228581:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779096.228592:0:8855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dfcc8d6/0xb1aa4014e936d5ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42599b expref: 6 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.228610:0:8855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001dfcc8d6/0xb1aa4014e936d5ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42599b expref: 6 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.228623:0:8855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7400, rc 0) 00000100:00100000:1.0:1790779096.228692:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2398:x1877767642751744:12345-192.168.203.3@tcp:101:bash.0 Request processed in 204us (9649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779096.228711:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00080000:0.0:1790779096.229132:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779096.237725:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779096.237827:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642751872 00000100:00100000:2.0:1790779096.237838:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642751872 00000100:00100000:2.0:1790779096.237943:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:2.0:1790779096.237953:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:12193:x1877767642751872:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1790779096.237973:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779096.237993:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259a2 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.238026:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001dfcc8d6/0xb1aa4014e936d5ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42599b expref: 7 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.238056:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779096.238061:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779096.238069:0:8438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.238119:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001dfcc8d6/0xb1aa4014e936d5ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42599b expref: 7 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.238133:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001dfcc8d6/0xb1aa4014e936d5ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42599b expref: 7 pid: 8855 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779096.238147:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760448df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1877767663792640:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779096.238246:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc300 going to sleep for 11 seconds 00000100:00100000:2.0:1790779096.243239:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760448df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1877767663792640:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779096.243286:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.243317:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b200, rc 0) 00000100:00100000:1.0:1790779096.243520:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779096.243581:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:12193:x1877767642751872:12345-192.168.203.3@tcp:101:bash.0 Request processed in 5629us (5865us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779096.243591:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:3.0:1790779096.243720:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642752000 00000100:00100000:3.0:1790779096.243730:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642752000 00010000:00010000:3.0:1790779096.243764:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001dfcc8d6/0xb1aa4014e936d5ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42599b expref: 7 pid: 8855 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779096.243820:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:3.0:1790779096.243831:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642752000:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779096.243845:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779096.243869:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001dfcc8d6/0xb1aa4014e936d5ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42599b expref: 7 pid: 8855 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.245504:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001dfcc8d6/0xb1aa4014e936d5ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42599b expref: 7 pid: 8855 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.245542:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dfcc8d6/0xb1aa4014e936d5ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b42599b expref: 7 pid: 8855 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.245559:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779096.245563:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779096.245571:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.245581:0:7465:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.245631:0:7465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779096.245647:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7465:1877767663792768:192.168.203.3@tcp:105: 00000100:00100000:3.0:1790779096.245773:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c540 going to sleep for 11 seconds 00000100:00100000:3.0:1790779096.251803:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7465:1877767663792768:192.168.203.3@tcp:105: 00010000:00010000:3.0:1790779096.251833:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779096.251914:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642752000:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 8084us (8393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779096.251926:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:1.0:1790779096.256952:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779096.257518:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642752256 00000100:00100000:0.0:1790779096.257528:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642752256 00000100:00100000:0.0:1790779096.257592:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:0.0:1790779096.257603:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+19:12193:x1877767642752256:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:2.0:1790779096.259858:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+20:12193:x1877767642752256:12345-192.168.203.3@tcp:35:bash.0 Request processed in 2244us (2901us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1790779096.259909:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:0.0:1790779096.358051:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779096.358160:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642752512 00000100:00100000:2.0:1790779096.358170:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642752512 00000100:00100000:2.0:1790779096.358278:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 157 00000100:00100000:2.0:1790779096.358290:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+20:12203:x1877767642752512:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779096.358314:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779096.358334:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d5f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259a9 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779096.358433:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790779096.358521:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d5f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a9 expref: 22 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.358534:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b76026e7b00) 00010000:00010000:2.0:1790779096.358537:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779096.358542:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d5f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a9 expref: 22 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.358560:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b600, rc 0) 00000100:00100000:2.0:1790779096.358618:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+21:12203:x1877767642752512:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 331us (576us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1790779096.358625:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 157 00000100:00100000:0.0:1790779096.363285:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779096.363553:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642752768 00000100:00100000:3.0:1790779096.363564:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642752768 00000100:00100000:3.0:1790779096.363663:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:3.0:1790779096.363673:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+21:12203:x1877767642752768:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779096.364029:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+22:12203:x1877767642752768:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 355us (752us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1790779096.364037:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:3.0:1790779096.440662:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779096.440825:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642752896 00000100:00100000:1.0:1790779096.440835:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642752896 00000100:00100000:1.0:1790779096.440927:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 158 00000100:00100000:1.0:1790779096.440937:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+22:12209:x1877767642752896:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779096.440967:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779096.441012:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d606 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259b0 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.441094:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d60d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.441109:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d60d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.441119:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d60d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779096.441158:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790779096.441162:0:13821:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779096.441179:0:13821:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d60d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.441204:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259b0 expref: 24 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.441221:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d60d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259b0 expref: 23 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.441229:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:1.0:1790779096.441232:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790779096.441235:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6400, rc 0) 00000100:00100000:1.0:1790779096.441354:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+23:12209:x1877767642752896:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 419us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779096.441362:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 158 00000100:00100000:0.0:1790779096.448564:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779096.449244:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642753152 00000100:00100000:3.0:1790779096.449266:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642753152 00000100:00100000:3.0:1790779096.449336:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 159 00000100:00100000:3.0:1790779096.449347:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+23:12209:x1877767642753152:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779096.449369:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779096.449391:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d614 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259b7 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.449512:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d61b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.449527:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d61b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.449554:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d61b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779096.449567:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790779096.449675:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d614 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259b7 expref: 26 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.449696:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d61b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259b7 expref: 25 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.449705:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:3.0:1790779096.449708:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779096.449711:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663600, rc 0) 00000100:00100000:3.0:1790779096.449950:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+25:12209:x1877767642753152:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 604us (1394us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1790779096.449958:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 159 00000100:00100000:0.0:1790779096.454931:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779096.454985:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779096.455517:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642753408 00000100:00100000:1.0:1790779096.455538:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642753408 00000100:00100000:1.0:1790779096.455601:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 160 00000100:00100000:1.0:1790779096.455612:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+25:12209:x1877767642753408:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779096.455639:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779096.455659:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d629 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.455769:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d630 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.455785:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d630 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.455797:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d630 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779096.455809:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790779096.455958:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d629 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259be expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.455977:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d630 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259be expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.455987:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:1.0:1790779096.455990:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790779096.455993:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6000, rc 0) 00000100:00100000:1.0:1790779096.456045:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+27:12209:x1877767642753408:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 435us (1125us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1790779096.456064:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 160 00000100:00100000:2.0:1790779096.456422:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642753536 00000100:00100000:2.0:1790779096.456428:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642753536 00000100:00100000:2.0:1790779096.456474:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:2.0:1790779096.456482:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+27:2398:x1877767642753536:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779096.456500:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779096.456515:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d61b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259b7 expref: 27 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.456529:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:2.0:1790779096.456531:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779096.456555:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+26:2398:x1877767642753536:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 75us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779096.456561:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:1.0:1790779096.464494:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779096.464580:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642753664 00000100:00100000:3.0:1790779096.464590:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642753664 00000100:00100000:3.0:1790779096.464648:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:3.0:1790779096.464659:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2400:x1877767642753664:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:3.0:1790779096.464702:0:8855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.464722:0:8855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.464731:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779096.464743:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790779096.464748:0:8855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.464784:0:8855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.464801:0:8855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 6 pid: 8438 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779096.464816:0:8855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8855:1877767663792896:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779096.464936:0:8855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c840 going to sleep for 11 seconds 00000100:00100000:3.0:1790779096.467675:0:8855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8855:1877767663792896:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779096.467707:0:8855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779096.468661:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779096.468906:0:8443:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642753792 00000100:00100000:2.0:1790779096.468915:0:8443:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642753792 00002000:00100000:2.0:1790779096.468964:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9b76046cf480 x1877767642753792/t0(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:647/0 lens 504/0 e 0 to 0 dl 1790779107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779096.468974:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76046cf480 with x1877767642753792 ext(0->12) 00010000:00010000:2.0:1790779096.468983:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 7 pid: 8438 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.468999:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 7 pid: 8438 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779096.469007:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b76046cf480 00000100:00100000:2.0:1790779096.469124:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1790779096.469134:0:8443:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642753792:12345-192.168.203.3@tcp:4:lfs.0 00000100:00100000:2.0:1790779096.469983:0:8443:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2400:x1877767642753792:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 848us (1325us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790779096.470000:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00002000:00100000:2.0:1790779096.470010:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9b76046cf480 x1877767642753792/t4294967306(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:647/0 lens 504/448 e 0 to 0 dl 1790779107 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779096.470018:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76046cf480 with x1877767642753792 ext(0->12) 00010000:00010000:2.0:1790779096.470026:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 9 pid: 8438 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.470040:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 9 pid: 8438 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779096.470059:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b76046cf480 00000100:00100000:0.0:1790779096.473369:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779096.474009:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642753920 00000100:00100000:2.0:1790779096.474019:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642753920 00010000:00010000:2.0:1790779096.474067:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 9 pid: 8438 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779096.474118:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:2.0:1790779096.474127:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2400:x1877767642753920:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779096.474142:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790779096.474158:0:6510:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790779096.474161:0:6510:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790779095 00002000:00010000:2.0:1790779096.474163:0:6510:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790779096 00002000:00010000:2.0:1790779096.474165:0:6510:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1790779095 00002000:00010000:2.0:1790779096.474168:0:6510:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1790779096.474174:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 9 pid: 8438 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.474202:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 9 pid: 8438 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.474227:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936d5f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259a2 expref: 9 pid: 8438 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.474245:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790779096.474249:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790779096.474255:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.474265:0:6510:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.474304:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779096.474368:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2400:x1877767642753920:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 242us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779096.474376:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00010000:00010000:1.0:1790779096.474453:0:8855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.474463:0:8855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.474481:0:8855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.474490:0:8855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.474499:0:8855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.474506:0:8855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779096.474511:0:8855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.474520:0:8855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.474532:0:8855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.474553:0:8855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009f2c497/0xb1aa4014e936d63e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779096.474602:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642753664:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 9945us (10117us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779096.474610:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1790779096.479800:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779096.479967:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642754176 00000100:00100000:2.0:1790779096.479978:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642754176 00000100:00100000:2.0:1790779096.480071:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:2.0:1790779096.480094:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718264050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+26:12209:x1877767642754176:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:2.0:1790779096.480163:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d630 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259be expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790779096.480477:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1790779096.480510:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1790779096.480870:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1790779096.480933:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.480948:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d5dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425994 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.480957:0:6526:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.480992:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d5dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425994 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.481007:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d5dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425994 expref: 30 pid: 6524 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779096.481020:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760448df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1877767663793024:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779096.481115:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779096.486349:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779096.486472:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642754304 00000100:00100000:1.0:1790779096.486482:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642754304 00010000:00010000:1.0:1790779096.486524:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d5dc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425994 expref: 31 pid: 6524 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779096.486577:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760448df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1877767663793024:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779096.486603:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779096.486816:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:1.0:1790779096.486825:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+31:2401:x1877767642754304:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779096.486840:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779096.486847:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d5dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425994 expref: 31 pid: 6524 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.486858:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d5dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425994 expref: 31 pid: 6524 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.486907:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d5dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425994 expref: 31 pid: 6524 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.486921:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:1.0:1790779096.486938:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.486945:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.486950:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.486974:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779096.487016:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+30:2401:x1877767642754304:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 192us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779096.487024:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00010000:00010000:2.0:1790779096.487096:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.487104:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790779096.487230:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1790779096.487356:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1790779096.487439:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760448df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663793152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790779096.487481:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779096.487513:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc780 going to sleep for 11 seconds 00000100:00100000:0.0:1790779096.487529:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663793152 00000100:00100000:0.0:1790779096.487535:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663793152 00000100:00100000:0.0:1790779096.487618:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790779096.487628:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760448f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1877767663793152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790779096.487711:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760448f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1877767663793152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779096.487729:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1790779096.488272:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760448df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663793152:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790779096.488381:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1790779096.488422:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760448df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663793280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790779096.488452:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779096.488477:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790779096.488495:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663793280 00000100:00100000:3.0:1790779096.488500:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663793280 00000100:00100000:3.0:1790779096.488529:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1790779096.488537:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1877767663793280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790779096.488659:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6526:x1877767663793280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 122us (205us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790779096.488666:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790779096.488732:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760448df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663793280:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790779096.488762:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1790779096.488791:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.488800:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.488806:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.488812:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779096.488816:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.488823:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.488848:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:2.0:1790779096.488851:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790779096.488855:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.488861:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d645 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790779096.488969:0:6526:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790779096.489382:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1790779096.489394:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414496514031ns, next at 415496511785ns, rc = 0 00000001:00080000:2.0:1790779096.489400:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1790779096.489420:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b7712a96500) 00010000:00010000:2.0:1790779096.489422:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790779096.489427:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d630 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259be expref: 34 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779096.489513:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718264050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+33:12209:x1877767642754176:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 9433us (9722us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1790779096.489521:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000020:00080000:2.0:1790779096.489524:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790779096.491308:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779096.491385:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642754432 00000100:00100000:1.0:1790779096.491394:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642754432 00000100:00100000:1.0:1790779096.491446:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:1.0:1790779096.491456:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+33:12209:x1877767642754432:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779096.491475:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779096.491490:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d64c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259c5 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.491530:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d64c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259c5 expref: 34 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.491539:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d64c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259c5 expref: 34 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.491550:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779096.491553:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779096.491568:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6800, rc 0) 00000100:00100000:1.0:1790779096.491627:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+34:12209:x1877767642754432:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 173us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779096.491632:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:0.0:1790779096.495281:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779096.495335:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642754688 00000100:00100000:3.0:1790779096.495345:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642754688 00000100:00100000:3.0:1790779096.495421:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:3.0:1790779096.495440:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+34:12209:x1877767642754688:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779096.495811:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+35:12209:x1877767642754688:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 370us (538us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1790779096.495820:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:0.0:1790779096.566185:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779096.566509:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642754944 00000100:00100000:2.0:1790779096.566520:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642754944 00000100:00100000:2.0:1790779096.566625:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00100000:2.0:1790779096.566636:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+35:12219:x1877767642754944:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779096.566660:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779096.566681:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d653 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259cc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779096.566816:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790779096.566939:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d653 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259cc expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.566953:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b76026e7b00) 00010000:00010000:2.0:1790779096.566956:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779096.566961:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259cc expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779096.566974:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b600, rc 0) 00000100:00100000:2.0:1790779096.567037:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+36:12219:x1877767642754944:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 403us (861us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1790779096.567054:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00100000:0.0:1790779096.572658:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779096.572990:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642755072 00000100:00100000:1.0:1790779096.573011:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642755072 00000100:00100000:1.0:1790779096.573123:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 163 00000100:00100000:1.0:1790779096.573136:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+36:12219:x1877767642755072:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:1.0:1790779096.573217:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d661 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573236:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d661 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573248:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d661 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573277:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573288:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573295:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573373:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d66f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573381:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d66f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573404:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d66f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790779096.573455:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d66f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573469:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d661 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573475:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d661 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573483:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d661 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573489:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779096.573493:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d661 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573502:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d661 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573513:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:1.0:1790779096.573516:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779096.573522:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d661 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573529:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d661 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573540:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573552:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d668 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573559:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573564:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779096.573568:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573574:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d668 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573582:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7712a96c00) 00010000:00010000:1.0:1790779096.573585:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779096.573588:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d668 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573594:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d668 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573604:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d66f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573610:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d66f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573616:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d66f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573621:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779096.573629:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d66f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573636:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d66f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573644:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779096.573647:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779096.573649:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d66f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.573655:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d66f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779096.573802:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+36:12219:x1877767642755072:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 669us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779096.573810:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 163 00000100:00100000:0.0:1790779096.576831:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779096.577136:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642755328 00000100:00100000:2.0:1790779096.577146:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642755328 00000100:00100000:2.0:1790779096.577228:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:2.0:1790779096.577238:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+36:12219:x1877767642755328:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779096.577455:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+37:12219:x1877767642755328:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 218us (634us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1790779096.577463:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:0.0:1790779096.617391:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779096.617527:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642755584 00000100:00100000:1.0:1790779096.617539:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642755584 00000100:00100000:1.0:1790779096.617607:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00100000:1.0:1790779096.617618:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+37:12222:x1877767642755584:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779096.617645:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779096.617671:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d676 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259d3 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.617832:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d67d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.617849:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d67d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.617911:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d67d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.617926:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d684 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.617935:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.617942:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618053:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d68b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618063:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d68b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618071:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d68b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779096.618093:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790779096.618169:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d67d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618177:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d67d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618185:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d67d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618191:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779096.618201:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d67d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618211:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d67d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618223:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:1.0:1790779096.618226:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779096.618230:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d67d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618237:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d67d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618251:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618258:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d684 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618264:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d684 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618270:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779096.618273:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d684 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618280:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d684 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618287:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7712a96c00) 00010000:00010000:1.0:1790779096.618290:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779096.618299:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d684 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618306:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d684 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618344:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936d676 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259d3 expref: 40 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618359:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d68b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259d3 expref: 39 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779096.618367:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779096.618369:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779096.618372:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7c00, rc 0) 00000100:00100000:1.0:1790779096.618431:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+39:12222:x1877767642755584:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 816us (1053us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1790779096.618439:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00100000:0.0:1790779096.624626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779096.627610:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642755712 00000100:00100000:3.0:1790779096.627625:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642755712 00000100:00100000:3.0:1790779096.627821:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 165 00000100:00100000:3.0:1790779096.627833:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+39:12222:x1877767642755712:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:3.0:1790779096.627927:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d699 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.627946:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.627958:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.627993:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.628000:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d699 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.628007:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d699 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.628013:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779096.628017:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d699 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.628042:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d699 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.628818:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:3.0:1790779096.628823:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790779096.628828:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d699 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.628834:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d699 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779096.628942:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+39:12222:x1877767642755712:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 1109us (4324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779096.628950:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 165 00000100:00100000:0.0:1790779096.635389:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779096.635465:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642755968 00000100:00100000:3.0:1790779096.635476:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642755968 00000100:00100000:3.0:1790779096.635536:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:3.0:1790779096.635546:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+39:12222:x1877767642755968:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779096.635788:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+40:12222:x1877767642755968:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 242us (410us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1790779096.635796:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:0.0:1790779096.989914:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779096.989998:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642756224 00000100:00100000:3.0:1790779096.990009:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642756224 00000100:00100000:3.0:1790779096.990088:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 166 00000100:00100000:3.0:1790779096.990099:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+40:12253:x1877767642756224:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:3.0:1790779096.990122:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779096.990141:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d6a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259da expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.990267:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d6a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.990283:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.990295:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779096.990305:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790779096.990412:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d6a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259da expref: 43 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.990431:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d6a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259da expref: 42 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779096.990440:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:3.0:1790779096.990443:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779096.990446:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662c00, rc 0) 00000100:00100000:3.0:1790779096.990686:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+42:12253:x1877767642756224:12345-192.168.203.3@tcp:101:cat.0 Request processed in 587us (806us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1790779096.990695:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 166 00000100:00100000:0.0:1790779096.998282:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779096.998402:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642756480 00000100:00100000:3.0:1790779096.998418:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642756480 00000100:00100000:3.0:1790779096.998498:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1790779096.998510:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+42:12253:x1877767642756480:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:3.0:1790779096.998963:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+43:12253:x1877767642756480:12345-192.168.203.3@tcp:35:cat.0 Request processed in 453us (689us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1790779096.998994:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:0.0:1790779097.012717:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779097.015323:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642756608 00000100:00100000:2.0:1790779097.015338:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642756608 00000100:00100000:2.0:1790779097.015426:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:2.0:1790779097.015438:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+43:2401:x1877767642756608:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779097.015456:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779097.015497:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d6a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259da expref: 43 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.015518:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:2.0:1790779097.015523:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779097.015604:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+42:2401:x1877767642756608:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 163us (2897us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779097.015613:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00080000:0.0:1790779097.016041:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779097.063015:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779097.063129:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642756864 00000100:00100000:1.0:1790779097.063139:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642756864 00000100:00100000:1.0:1790779097.063194:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 167 00000100:00100000:1.0:1790779097.063204:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+42:12259:x1877767642756864:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:1.0:1790779097.063228:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779097.063231:0:13821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790779097.063254:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d60d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259b0 expref: 42 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.063274:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:1.0:1790779097.063279:0:13821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779097.063306:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d6b5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259e1 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.063405:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.063419:0:13821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d68b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259d3 expref: 42 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.063429:0:13821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.063460:0:13821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d68b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259d3 expref: 42 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.063475:0:13821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d68b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259d3 expref: 42 pid: 13821 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779097.063488:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663793408:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779097.063719:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76035bdf00 going to sleep for 11 seconds 00010000:00010000:1.0:1790779097.064604:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779097.072922:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779097.072980:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642756992 00000100:00100000:2.0:1790779097.072990:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642756992 00000100:00100000:3.0:1790779097.072992:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663793408:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779097.073035:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d68b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259d3 expref: 43 pid: 13821 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.073052:0:13821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779097.073099:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:2.0:1790779097.073117:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+43:2401:x1877767642756992:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779097.073133:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779097.073140:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d68b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259d3 expref: 43 pid: 13821 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.073154:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d68b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259d3 expref: 43 pid: 13821 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.073175:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d68b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259d3 expref: 43 pid: 13821 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.073191:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:2.0:1790779097.073196:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.073220:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.073228:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.073252:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779097.073309:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+42:2401:x1877767642756992:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 199us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779097.073317:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00010000:00010000:3.0:1790779097.073407:0:13821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.073415:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779097.073439:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790779097.073680:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d6b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e1 expref: 43 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.073705:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e1 expref: 42 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.073715:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:3.0:1790779097.073718:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790779097.073721:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6000, rc 0) 00000100:00100000:3.0:1790779097.073791:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+42:12259:x1877767642756864:12345-192.168.203.3@tcp:101:dd.0 Request processed in 10588us (10784us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1790779097.073801:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 167 00000100:00100000:1.0:1790779097.077739:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779097.077933:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642757120 00000100:00100000:2.0:1790779097.077944:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642757120 00000100:00100000:2.0:1790779097.078068:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 168 00000100:00100000:2.0:1790779097.078088:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+42:12259:x1877767642757120:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1790779097.078113:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779097.078134:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d6ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259e8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.078168:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d6d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.078181:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.078193:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.078312:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d6ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e8 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.078344:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e8 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.078354:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:2.0:1790779097.078357:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790779097.078360:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b200, rc 0) 00000100:00100000:2.0:1790779097.078417:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+43:12259:x1877767642757120:12345-192.168.203.3@tcp:101:dd.0 Request processed in 341us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779097.078424:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 168 00000100:00100000:0.0:1790779097.084531:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779097.084824:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642757376 00000100:00100000:1.0:1790779097.084837:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642757376 00000100:00100000:1.0:1790779097.085238:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 169 00000100:00100000:1.0:1790779097.085788:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+43:12259:x1877767642757376:12345-192.168.203.3@tcp:36:dd.0 00010000:00010000:1.0:1790779097.087351:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.087473:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.087488:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779097.087563:0:6523:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1790779097.087598:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fe236960 reply state 00000000d8a9377c transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.087612:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.087620:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779097.087623:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779097.087628:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779097.089366:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+46:12259:x1877767642757376:12345-192.168.203.3@tcp:36:dd.0 Request processed in 4104us (4834us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1790779097.089392:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 169 00000020:00080000:1.0:1790779097.089400:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790779097.383173:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779097.383339:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642757504 00000100:00100000:2.0:1790779097.383353:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642757504 00000100:00100000:2.0:1790779097.383428:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 170 00000100:00100000:2.0:1790779097.383438:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+46:12273:x1877767642757504:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:2.0:1790779097.383469:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779097.383498:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d6df lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259ef expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.383578:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d6e6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.383596:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d6e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.383607:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d6e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.383627:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d6ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.383642:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.383648:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.383741:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.383750:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e1 expref: 47 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.383760:0:6525:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.383803:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e1 expref: 47 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.383815:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e1 expref: 47 pid: 13821 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779097.383829:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f50d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1877767663793536:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779097.383979:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc300 going to sleep for 11 seconds 00000100:00100000:0.0:1790779097.386423:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779097.386474:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642757760 00000100:00100000:3.0:1790779097.386486:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642757760 00000100:00100000:3.0:1790779097.386553:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:3.0:1790779097.386565:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+48:6168:x1877767642757760:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790779097.386972:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+49:6168:x1877767642757760:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 406us (560us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1790779097.386982:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:2.0:1790779097.387341:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f50d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1877767663793536:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779097.387374:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779097.390461:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779097.390550:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642757888 00000100:00100000:2.0:1790779097.390584:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642757888 00010000:00010000:2.0:1790779097.390753:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e1 expref: 49 pid: 13821 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779097.390802:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:2.0:1790779097.390816:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+49:2400:x1877767642757888:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779097.390840:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779097.390848:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e1 expref: 49 pid: 13821 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.390864:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e1 expref: 49 pid: 13821 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.390935:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936d6bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e1 expref: 49 pid: 13821 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.390957:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:2.0:1790779097.390963:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.390974:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.390984:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.391030:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779097.391123:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+48:2400:x1877767642757888:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 310us (681us total) trans 0 rc 0/0 00010000:00010000:1.0:1790779097.391141:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779097.391147:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 82 00010000:00010000:1.0:1790779097.391159:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779097.391245:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790779097.391252:0:6525:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779097.391290:0:6525:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391319:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391331:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d6e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391340:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d6e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391348:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d6e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391356:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ba00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779097.391361:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d6e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391370:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d6e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391383:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:1.0:1790779097.391387:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779097.391392:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d6e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391398:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d6e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391412:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391419:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d6ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391433:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d6ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391439:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ae00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779097.391442:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d6ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391448:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d6ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391458:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7712a96c00) 00010000:00010000:1.0:1790779097.391460:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779097.391463:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d6ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391469:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d6ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391514:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d6df lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259ef expref: 48 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391531:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259ef expref: 47 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.391539:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779097.391541:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779097.391544:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b800, rc 0) 00000100:00100000:1.0:1790779097.391578:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+47:12273:x1877767642757504:12345-192.168.203.3@tcp:101:stat.0 Request processed in 8141us (8416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779097.391596:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 170 00000100:00100000:3.0:1790779097.453088:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779097.455257:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642758144 00000100:00100000:1.0:1790779097.455278:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642758144 00000100:00100000:1.0:1790779097.455371:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:1.0:1790779097.455383:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+47:12279:x1877767642758144:12345-192.168.203.3@tcp:36:truncate.0 00010000:00010000:1.0:1790779097.455491:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779097.455525:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d6f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259ef expref: 47 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.455551:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779097.455557:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779097.455765:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.455783:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.455795:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779097.455845:0:6524:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1790779097.455865:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000202837c6 reply state 000000004c0bff39 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.455934:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.455942:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779097.455945:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779097.455955:0:6524:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779097.456098:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+49:12279:x1877767642758144:12345-192.168.203.3@tcp:36:truncate.0 Request processed in 717us (3031us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1790779097.456106:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 171 00000020:00080000:1.0:1790779097.456112:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790779097.661176:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779097.675116:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642758272 00000100:00100000:3.0:1790779097.675141:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642758272 00000100:00100000:3.0:1790779097.676125:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00100000:3.0:1790779097.676139:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+49:12293:x1877767642758272:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:3.0:1790779097.676346:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779097.676380:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d702 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259f6 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.677353:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d709 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.677376:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d709 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.677390:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d709 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.677403:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d710 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.677411:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.677418:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.677969:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.682844:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.683165:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779097.686225:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1790779097.686239:0:13003:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779097.686291:0:13003:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686317:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686330:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d709 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686340:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d709 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686349:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d709 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686355:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779097.686361:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d709 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686370:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d709 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686488:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779097.686492:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779097.686499:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d709 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686505:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d709 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686531:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686603:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d710 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686612:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d710 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686617:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779097.686621:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d710 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686701:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d710 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686711:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7712a96c00) 00010000:00010000:3.0:1790779097.686713:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779097.686716:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d710 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686721:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d710 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686849:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d702 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259f6 expref: 51 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.686875:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259f6 expref: 50 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.687258:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:3.0:1790779097.687261:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779097.687264:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662000, rc 0) 00000100:00100000:3.0:1790779097.687370:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+50:12293:x1877767642758272:12345-192.168.203.3@tcp:101:stat.0 Request processed in 11232us (26206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779097.687389:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00100000:2.0:1790779097.707033:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779097.707063:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663793664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779097.707150:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779097.708345:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663793664 00000100:00100000:0.0:1790779097.708364:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663793664 00000100:00100000:0.0:1790779097.708459:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790779097.708485:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663793664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779097.708796:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1790779097.709016:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663793664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 532us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779097.709025:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790779097.710373:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663793664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779097.804621:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779097.804933:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642758528 00000100:00100000:3.0:1790779097.804949:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642758528 00000100:00100000:3.0:1790779097.805047:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 173 00000100:00100000:3.0:1790779097.805059:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+50:12303:x1877767642758528:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779097.805102:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779097.805134:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d71e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b4259fd expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779097.805307:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790779097.805743:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d71e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259fd expref: 52 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.805769:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b76026e7b00) 00010000:00010000:3.0:1790779097.805772:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790779097.805794:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d71e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259fd expref: 52 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.805813:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662800, rc 0) 00000100:00100000:3.0:1790779097.807508:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+51:12303:x1877767642758528:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 2432us (2883us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1790779097.807522:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 173 00000100:00100000:1.0:1790779097.815714:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779097.815850:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642758784 00000100:00100000:0.0:1790779097.815860:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642758784 00000100:00100000:0.0:1790779097.815948:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:0.0:1790779097.815958:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718265450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+51:12303:x1877767642758784:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1790779097.816189:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718265450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+52:12303:x1877767642758784:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 231us (485us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1790779097.816198:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:0.0:1790779097.940819:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779097.943728:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642759040 00000100:00100000:3.0:1790779097.943747:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642759040 00000100:00100000:3.0:1790779097.943925:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 174 00000100:00100000:3.0:1790779097.943936:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+52:12309:x1877767642759040:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779097.943962:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779097.943984:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d72c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a04 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.944108:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.944124:0:10428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259f6 expref: 53 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.944133:0:10428:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.944168:0:10428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259f6 expref: 53 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.944181:0:10428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259f6 expref: 53 pid: 13003 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779097.944216:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663793792:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779097.944332:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c600 going to sleep for 11 seconds 00000100:00100000:1.0:1790779097.952614:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779097.952948:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663793792:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779097.952975:0:10428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779097.953064:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642759168 00000100:00100000:2.0:1790779097.953083:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642759168 00010000:00010000:2.0:1790779097.953122:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259f6 expref: 54 pid: 13003 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779097.953164:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:2.0:1790779097.953174:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+54:2400:x1877767642759168:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779097.953189:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779097.953197:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259f6 expref: 54 pid: 13003 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.953210:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259f6 expref: 54 pid: 13003 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.953233:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d717 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259f6 expref: 54 pid: 13003 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.953252:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:2.0:1790779097.953256:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.953287:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.953294:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.953464:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779097.953739:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+53:2400:x1877767642759168:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 565us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779097.953747:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 83 00010000:00010000:0.0:1790779097.954538:0:10428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779097.954549:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779097.954568:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1790779097.954705:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d72c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a04 expref: 54 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779097.954724:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a04 expref: 53 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779097.954734:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:0.0:1790779097.954737:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790779097.954740:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662a00, rc 0) 00000100:00100000:0.0:1790779097.954780:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+53:12309:x1877767642759040:12345-192.168.203.3@tcp:101:bash.0 Request processed in 10847us (13971us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1790779097.954788:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 174 00000100:00100000:2.0:1790779097.969998:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779097.970273:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642759424 00000100:00100000:1.0:1790779097.970284:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642759424 00000100:00100000:1.0:1790779097.970345:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 175 00000100:00100000:1.0:1790779097.970356:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+53:12309:x1877767642759424:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:1.0:1790779097.970598:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.970617:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.970629:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779097.970672:0:6523:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1790779097.970694:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000068978632 reply state 00000000cb4d1057 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.970706:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779097.970714:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779097.970717:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779097.970721:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779097.970808:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+56:12309:x1877767642759424:12345-192.168.203.3@tcp:36:bash.0 Request processed in 454us (822us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1790779097.970828:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 175 00000020:00080000:1.0:1790779097.970834:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790779097.975576:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779097.975862:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642759552 00000100:00100000:2.0:1790779097.975875:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642759552 00000100:00100000:2.0:1790779097.976016:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 176 00000100:00100000:2.0:1790779097.976029:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+56:12309:x1877767642759552:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1790779097.976084:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779097.976116:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d748 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a0b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.976267:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d74f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.976290:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a04 expref: 57 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.976301:0:6525:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d74f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.976350:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a04 expref: 57 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.976388:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a04 expref: 57 pid: 10428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779097.976406:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1877767663793920:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779097.977377:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1790779097.983059:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779097.983284:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642759680 00000100:00100000:3.0:1790779097.983298:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642759680 00010000:00010000:3.0:1790779097.983358:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a04 expref: 58 pid: 10428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779097.983416:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:3.0:1790779097.983428:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+58:2401:x1877767642759680:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779097.983447:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779097.983456:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a04 expref: 58 pid: 10428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.983470:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a04 expref: 58 pid: 10428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.983501:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:3.0:1790779097.983508:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d74f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.983521:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.983822:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d74f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779097.983855:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779097.983990:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+58:2401:x1877767642759680:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 561us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779097.984000:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 84 00010000:00010000:2.0:1790779097.984821:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d733 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a04 expref: 57 pid: 10428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779097.984851:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1877767663793920:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779097.984932:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.984944:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.984951:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779097.985032:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790779097.985047:0:6525:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779097.985088:0:6525:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.985139:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d748 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a0b expref: 57 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.985158:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d74f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a0b expref: 56 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779097.985187:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:2.0:1790779097.985190:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779097.985194:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894ae00, rc 0) 00000100:00100000:2.0:1790779097.985492:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+56:12309:x1877767642759552:12345-192.168.203.3@tcp:101:bash.0 Request processed in 9464us (9930us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779097.985502:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 176 00000100:00100000:0.0:1790779097.993145:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779097.993288:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642759936 00000100:00100000:2.0:1790779097.993303:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642759936 00000100:00100000:2.0:1790779097.993393:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:2.0:1790779097.993408:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+56:12309:x1877767642759936:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:2.0:1790779097.993944:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+57:12309:x1877767642759936:12345-192.168.203.3@tcp:35:bash.0 Request processed in 535us (812us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1790779097.993953:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00010000:00010000:2.0:1790779098.088303:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779098.110058:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779098.110238:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642760192 00000100:00100000:1.0:1790779098.110254:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642760192 00000100:00100000:1.0:1790779098.110340:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 177 00000100:00100000:1.0:1790779098.110352:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+57:12319:x1877767642760192:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779098.110383:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779098.110410:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a12 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779098.110546:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1790779098.110697:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d756 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a12 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.110715:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b76026e7b00) 00010000:00010000:1.0:1790779098.110718:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790779098.110725:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a12 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.110743:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6c00, rc 0) 00000100:00100000:1.0:1790779098.110832:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+58:12319:x1877767642760192:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 482us (800us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1790779098.110840:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 177 00000100:00100000:1.0:1790779098.115173:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.115263:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642760320 00000100:00100000:3.0:1790779098.115277:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642760320 00000100:00100000:3.0:1790779098.115359:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 178 00000100:00100000:3.0:1790779098.115372:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+58:12319:x1877767642760320:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:3.0:1790779098.115482:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d764 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.115504:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d764 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.115517:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d764 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.115528:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d76b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.115544:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d76b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.115552:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d76b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.115659:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d772 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.115687:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.115694:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779098.116025:0:13003:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116044:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d764 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116052:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d764 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116061:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d764 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116079:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779098.116084:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d764 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116092:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d764 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116107:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779098.116111:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779098.116118:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d764 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116124:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d764 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116155:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d76b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116162:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d76b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116168:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d76b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116174:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779098.116177:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d76b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116184:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d76b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116192:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7712a96c00) 00010000:00010000:3.0:1790779098.116194:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779098.116197:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d76b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116202:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d76b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116213:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116220:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d772 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116225:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d772 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116237:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779098.116241:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d772 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116247:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d772 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116256:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:3.0:1790779098.116258:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779098.116262:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d772 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.116268:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d772 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779098.116389:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+58:12319:x1877767642760320:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 1017us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779098.116399:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 178 00000100:00100000:2.0:1790779098.121438:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.122524:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642760576 00000100:00100000:3.0:1790779098.122607:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642760576 00000100:00100000:3.0:1790779098.122899:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:3.0:1790779098.122913:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+58:12319:x1877767642760576:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779098.123445:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+59:12319:x1877767642760576:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 531us (2019us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1790779098.123455:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:2.0:1790779098.171927:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.172027:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642760832 00000100:00100000:3.0:1790779098.172050:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642760832 00000100:00100000:3.0:1790779098.172136:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:3.0:1790779098.172174:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+59:12322:x1877767642760832:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779098.172209:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779098.172235:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d779 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a19 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.172337:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d780 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.172354:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d780 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.172367:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d780 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.172378:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d787 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.172384:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.172390:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.172521:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d78e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.173769:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d78e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.173789:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d78e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779098.173832:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790779098.173983:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d780 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.173994:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d780 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174003:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d780 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174010:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779098.174015:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d780 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174023:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d780 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174046:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779098.174050:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779098.174056:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d780 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174063:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d780 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174092:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174099:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d787 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174119:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174124:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779098.174127:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174133:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174143:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7712a96c00) 00010000:00010000:3.0:1790779098.174146:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779098.174149:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d787 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174155:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d787 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174218:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d779 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a19 expref: 62 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174235:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d78e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a19 expref: 61 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.174243:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:3.0:1790779098.174246:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779098.174248:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662800, rc 0) 00000100:00100000:3.0:1790779098.174363:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+61:12322:x1877767642760832:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 2194us (2488us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1790779098.174384:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:1.0:1790779098.187174:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779098.187229:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779098.187353:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642761088 00000100:00100000:0.0:1790779098.187367:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642761088 00000100:00100000:0.0:1790779098.187452:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:0.0:1790779098.187464:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+61:2398:x1877767642761088:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779098.187484:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779098.187516:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936d78e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a19 expref: 61 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.187543:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:0.0:1790779098.187550:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779098.187628:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+60:2398:x1877767642761088:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 166us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779098.187637:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1790779098.187821:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642760960 00000100:00100000:2.0:1790779098.187826:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642760960 00000100:00100000:2.0:1790779098.187873:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:2.0:1790779098.187911:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+60:12322:x1877767642760960:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:2.0:1790779098.187990:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d79c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.188009:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d79c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.188039:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d79c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.188094:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d79c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.188102:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d79c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.188109:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d79c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.188115:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779098.188120:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d79c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.188128:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d79c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.188139:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:2.0:1790779098.188144:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779098.188148:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d79c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.188154:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d79c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779098.188212:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+60:12322:x1877767642760960:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 331us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779098.188221:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:1.0:1790779098.191803:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779098.191929:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642761344 00000100:00100000:2.0:1790779098.191961:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642761344 00000100:00100000:2.0:1790779098.192029:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:2.0:1790779098.192048:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+60:12322:x1877767642761344:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779098.192377:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+61:12322:x1877767642761344:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 338us (589us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1790779098.192386:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:3.0:1790779098.290106:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.290220:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.290261:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.290298:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.290317:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.290345:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.290402:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642761728 00000100:00100000:3.0:1790779098.290415:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642761728 00000100:00100000:3.0:1790779098.290504:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642761856 00000100:00100000:3.0:1790779098.290508:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642761856 00000100:00100000:3.0:1790779098.290545:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:3.0:1790779098.290558:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642761728:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779098.291593:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:0.0:1790779098.291617:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2401:x1877767642761856:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779098.291703:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2401:x1877767642761856:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 96us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779098.291711:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:3.0:1790779098.291723:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642761728:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1168us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779098.291731:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00080000:0.0:1790779098.291745:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790779098.291750:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779098.291766:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642761984 00000100:00100000:3.0:1790779098.291772:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642761984 00000100:00100000:1.0:1790779098.292121:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642761600 00000100:00100000:1.0:1790779098.292126:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642761600 00000100:00100000:3.0:1790779098.292201:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642762112 00000100:00100000:3.0:1790779098.292205:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642762112 00000100:00100000:2.0:1790779098.292924:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642761472 00000100:00100000:2.0:1790779098.292932:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642761472 00000100:00100000:2.0:1790779098.292990:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 389 00000100:00100000:2.0:1790779098.293001:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642761472:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779098.293197:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642761472:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 198us (3105us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779098.293206:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 389 00000100:00100000:2.0:1790779098.293276:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 320 00000100:00100000:2.0:1790779098.293286:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642761984:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779098.293322:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642761984:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 38us (3060us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779098.293329:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 320 00000100:00080000:0.0:1790779098.304000:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790779098.304016:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779098.308521:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 321 00000100:00100000:1.0:1790779098.308555:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642761600:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779098.310032:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642761600:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1483us (19718us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779098.310055:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 321 00000100:00100000:2.0:1790779098.315818:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 322 00000100:00100000:2.0:1790779098.315840:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642762112:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779098.316008:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642762112:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 175us (25660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779098.316016:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 322 00000100:00100000:2.0:1790779098.403570:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.403816:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642762368 00000100:00100000:3.0:1790779098.403829:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642762368 00000100:00100000:3.0:1790779098.403958:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:3.0:1790779098.403970:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+61:12340:x1877767642762368:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:3.0:1790779098.404004:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779098.404046:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a20 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.404235:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d7aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.404254:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d7aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.404269:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d7aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779098.404282:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790779098.404425:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a20 expref: 64 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.404449:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d7aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a20 expref: 63 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.404460:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:3.0:1790779098.404464:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790779098.404468:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663a00, rc 0) 00000100:00100000:3.0:1790779098.404559:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12340:x1877767642762368:12345-192.168.203.3@tcp:101:cat.0 Request processed in 592us (1003us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1790779098.404567:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:3.0:1790779098.457179:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779098.457442:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642762496 00000100:00100000:1.0:1790779098.457456:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642762496 00000100:00100000:1.0:1790779098.457547:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:1.0:1790779098.457560:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12341:x1877767642762496:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779098.457596:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779098.457811:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d7b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a27 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.463495:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d7bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.463673:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d7bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.463714:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d7bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779098.463786:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1790779098.463791:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779098.463819:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d7bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.463871:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d7b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a27 expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.465194:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d7bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a27 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.465213:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:0.0:1790779098.465217:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790779098.465222:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769e00, rc 0) 00000100:00100000:0.0:1790779098.465499:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+64:12341:x1877767642762496:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 7938us (8333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779098.465512:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:0.0:1790779098.483714:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779098.483961:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642762880 00000100:00100000:2.0:1790779098.483974:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642762880 00000100:00100000:2.0:1790779098.484128:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:2.0:1790779098.484142:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+64:12341:x1877767642762880:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779098.484936:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12341:x1877767642762880:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 793us (1233us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1790779098.484947:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:2.0:1790779098.500006:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779098.500197:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642763008 00000100:00100000:1.0:1790779098.500211:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642763008 00000100:00100000:1.0:1790779098.500308:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1790779098.500321:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12341:x1877767642763008:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:1.0:1790779098.500342:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790779098.500375:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d74f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a0b expref: 65 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.500407:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936d7aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a20 expref: 64 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.500453:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d64c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259c5 expref: 63 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.500465:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779098.500471:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779098.500553:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+62:12341:x1877767642763008:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 235us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779098.500562:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1790779098.503347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779098.503526:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642763136 00000100:00100000:0.0:1790779098.503550:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642763136 00000100:00100000:0.0:1790779098.503684:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:0.0:1790779098.503695:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+62:12341:x1877767642763136:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:0.0:1790779098.503866:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d7c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.503941:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d7c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.503954:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d7c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790779098.504095:0:10428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1790779098.504205:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+62:12341:x1877767642763136:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 512us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779098.504214:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:0.0:1790779098.563358:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.563538:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642763264 00000100:00100000:3.0:1790779098.563553:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642763264 00000100:00100000:3.0:1790779098.563632:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:3.0:1790779098.563644:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+62:12343:x1877767642763264:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779098.563692:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779098.563722:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a2e expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.563809:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7d4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.563827:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.563842:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.563855:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.563863:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.563870:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564005:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564016:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564023:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779098.564374:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790779098.564388:0:13821:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779098.564417:0:13821:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564430:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564440:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564447:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7d4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564455:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564461:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779098.564466:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564474:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7d4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564488:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779098.564491:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779098.564497:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564503:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564519:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564691:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564697:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564701:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779098.564705:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564710:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564719:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7712a96c00) 00010000:00010000:3.0:1790779098.564722:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779098.564725:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7db lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564730:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564767:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a2e expref: 64 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564781:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a2e expref: 63 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.564788:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:3.0:1790779098.564790:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779098.564799:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662c00, rc 0) 00000100:00100000:3.0:1790779098.564994:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12343:x1877767642763264:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1351us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779098.565004:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 184 00000040:00080000:1.0:1790779098.738417:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790779098.738431:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790779098.738464:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1790779098.738476:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790779098.738865:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663794048:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790779098.743922:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76035bda80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779098.748542:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663794048:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790779098.752211:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779098.752504:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642763392 00000100:00100000:1.0:1790779098.752518:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642763392 00000100:00100000:1.0:1790779098.752598:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 185 00000100:00100000:1.0:1790779098.752720:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12354:x1877767642763392:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790779098.752766:0:13003:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790779098.752957:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12354:x1877767642763392:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 349us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779098.752966:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 185 00000100:00100000:0.0:1790779098.779149:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.779289:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642763520 00000100:00100000:3.0:1790779098.779303:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642763520 00000100:00100000:3.0:1790779098.779397:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:3.0:1790779098.779409:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12354:x1877767642763520:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790779098.779505:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7e9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779527:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779541:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779559:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779567:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779573:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779606:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779651:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779660:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779098.779720:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790779098.779725:0:6525:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779098.779741:0:6525:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779755:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779763:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7e9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779772:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779779:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779098.779783:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779792:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7e9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779805:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:3.0:1790779098.779809:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779098.779814:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779832:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d7e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779850:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779857:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7f0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779863:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779868:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779098.779871:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779918:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7f0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779928:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9b7703991600) 00010000:00010000:3.0:1790779098.779930:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779098.779934:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7f0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779940:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d7f0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779960:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779967:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779980:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779986:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779098.779989:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.779996:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.780004:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:3.0:1790779098.780007:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779098.780010:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.780016:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d7f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779098.780134:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12354:x1877767642763520:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 725us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779098.780143:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:0.0:1790779098.785634:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779098.785774:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642763776 00000100:00100000:1.0:1790779098.785787:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642763776 00000100:00100000:1.0:1790779098.785861:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:1.0:1790779098.785912:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12354:x1877767642763776:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779098.785941:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779098.785969:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d7fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a35 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786156:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d805 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786177:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786191:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779098.786205:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790779098.786308:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786317:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d805 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786325:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786332:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779098.786338:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786346:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d805 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786362:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779098.786374:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790779098.786381:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d805 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786388:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936d805 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786443:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d7fe lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a35 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786454:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:1.0:1790779098.786457:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790779098.786461:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936d7fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a35 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.786472:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6a00, rc 0) 00000100:00100000:1.0:1790779098.786546:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+64:12354:x1877767642763776:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 638us (926us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1790779098.786554:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:3.0:1790779098.790774:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779098.790850:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642763904 00000100:00100000:1.0:1790779098.790867:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642763904 00000100:00100000:1.0:1790779098.790992:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:1.0:1790779098.791004:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+64:12354:x1877767642763904:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790779098.791048:0:13003:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790779098.791205:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+64:12354:x1877767642763904:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 203us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779098.791213:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:3.0:1790779098.808620:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.808664:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642764160 00000100:00100000:3.0:1790779098.808725:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642764160 00000100:00100000:3.0:1790779098.808801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:3.0:1790779098.808813:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+64:12354:x1877767642764160:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779098.808843:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779098.808866:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790779098.808925:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d7bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a27 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.808949:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779098.808955:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779098.808973:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d813 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a3c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790779098.809528:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1790779098.809716:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d81a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.809734:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d81a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.809747:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d81a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.809811:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d813 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a3c expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.809831:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d81a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a3c expref: 65 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779098.809840:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7703991600) 00010000:00010000:3.0:1790779098.809843:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779098.809846:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662000, rc 0) 00000100:00100000:3.0:1790779098.809960:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12354:x1877767642764160:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1149us (1368us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1790779098.809980:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:0.0:1790779098.820200:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779098.820318:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642764416 00000100:00100000:2.0:1790779098.820333:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642764416 00000100:00100000:2.0:1790779098.820422:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:2.0:1790779098.820433:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12354:x1877767642764416:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790779098.820523:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779098.820557:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d81a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a3c expref: 65 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820580:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7703991600) 00010000:00010000:2.0:1790779098.820593:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779098.820789:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d828 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820807:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d828 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820818:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d828 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820836:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d82f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x3734eeb1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820852:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d82f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3734eeb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820859:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d82f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3734eeb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820941:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d828 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820950:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d828 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820958:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d828 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820965:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779098.820970:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d828 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820978:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d828 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820987:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:2.0:1790779098.820989:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779098.820993:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d828 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.820999:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d828 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.821011:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d82f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3734eeb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.821023:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d82f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3734eeb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.821029:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d82f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3734eeb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.821033:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ba00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779098.821037:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d82f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3734eeb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.821044:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d82f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3734eeb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.821053:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x3734eeb1 (ffff9b7712a96300) 00010000:00010000:2.0:1790779098.821056:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779098.821059:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d82f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3734eeb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.821078:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d82f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3734eeb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779098.821191:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+64:12354:x1877767642764416:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 758us (1002us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790779098.821200:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:3.0:1790779098.826998:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779098.827093:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642764544 00000100:00100000:0.0:1790779098.827110:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642764544 00000100:00100000:0.0:1790779098.827197:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:0.0:1790779098.827209:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+64:12354:x1877767642764544:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779098.827240:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779098.827272:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d836 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a43 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.827321:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d83d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.827349:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d83d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.827363:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d83d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.827528:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d836 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a43 expref: 66 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.827548:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d83d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a43 expref: 65 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.827558:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:0.0:1790779098.827561:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790779098.827565:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769e00, rc 0) 00000100:00100000:0.0:1790779098.827914:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12354:x1877767642764544:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 672us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779098.827923:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:3.0:1790779098.830203:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779098.830792:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642764800 00000100:00100000:0.0:1790779098.830809:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642764800 00000100:00100000:0.0:1790779098.830925:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:0.0:1790779098.830938:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12354:x1877767642764800:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790779098.831048:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.831081:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.831095:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790779098.831322:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1790779098.832773:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416838454549ns, next at 417838451037ns, rc = 0 00000004:00010000:0.0:1790779098.832942:0:6525:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006e9e805a reply state 000000007cdbc13f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.832966:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.832977:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:0.0:1790779098.832980:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790779098.832985:0:6525:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790779098.833156:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+67:12354:x1877767642764800:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 2216us (2960us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1790779098.833166:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:2.0:1790779098.841359:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779098.845490:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642764928 00000100:00100000:0.0:1790779098.845506:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642764928 00000100:00100000:0.0:1790779098.846046:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:0.0:1790779098.846057:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+67:12354:x1877767642764928:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779098.846092:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779098.846115:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d84b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a4a expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.846175:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d84b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a4a expref: 68 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.846191:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d84b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a4a expref: 68 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.846210:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:0.0:1790779098.846213:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790779098.846223:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769600, rc 0) 00000100:00100000:0.0:1790779098.846348:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+68:12354:x1877767642764928:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 292us (4999us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779098.846355:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:3.0:1790779098.851676:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779098.851865:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642765056 00000100:00100000:0.0:1790779098.851876:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642765056 00000100:00100000:0.0:1790779098.851967:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:0.0:1790779098.851977:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+6:2401:x1877767642765056:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790779098.852207:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2401:x1877767642765056:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 231us (541us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1790779098.852214:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:3.0:1790779098.863239:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779098.863987:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642765312 00000100:00100000:2.0:1790779098.863998:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642765312 00000100:00100000:2.0:1790779098.864058:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:2.0:1790779098.864077:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+68:12354:x1877767642765312:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790779098.864367:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+69:12354:x1877767642765312:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 290us (1137us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1790779098.864375:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:2.0:1790779098.886686:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.887612:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642765568 00000100:00100000:3.0:1790779098.887622:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642765568 00000100:00100000:3.0:1790779098.887679:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 194 00000100:00100000:3.0:1790779098.887689:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+69:12354:x1877767642765568:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790779098.887830:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+69:12354:x1877767642765568:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 143us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779098.887837:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 194 00000100:00100000:3.0:1790779098.890905:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779098.891030:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642765696 00000100:00100000:2.0:1790779098.891039:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642765696 00000100:00100000:2.0:1790779098.891499:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:2.0:1790779098.891510:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+69:12354:x1877767642765696:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779098.891530:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779098.891612:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d852 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a51 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.891698:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d859 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.891713:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.891725:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779098.891773:0:10428:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779098.891794:0:10428:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.891818:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936d852 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a51 expref: 71 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.891834:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a51 expref: 70 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.891847:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:2.0:1790779098.891850:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790779098.891854:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b600, rc 0) 00000100:00100000:2.0:1790779098.891951:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+70:12354:x1877767642765696:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 443us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779098.891959:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:2.0:1790779098.898613:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779098.898682:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642765824 00000100:00100000:1.0:1790779098.898702:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642765824 00000100:00100000:1.0:1790779098.898768:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:1.0:1790779098.898778:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2399:x1877767642765824:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779098.898798:0:8855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779098.898820:0:8855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdbd50d0/0xb1aa4014e936d860 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a58 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790779098.898846:0:8855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd1eda, blocks: 0x0 00010000:00010000:1.0:1790779098.898866:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1790779098.898871:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779098.898937:0:8855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdbd50d0/0xb1aa4014e936d860 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a58 expref: 8 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.898958:0:8855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bdbd50d0/0xb1aa4014e936d860 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a58 expref: 8 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.898972:0:8855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7000, rc 0) 00000100:00100000:1.0:1790779098.899224:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2399:x1877767642765824:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 438us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779098.899234:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1790779098.908159:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.908471:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642766080 00000100:00100000:3.0:1790779098.908481:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642766080 00000100:00100000:3.0:1790779098.908591:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 196 00000100:00100000:3.0:1790779098.908602:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+70:12354:x1877767642766080:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790779098.908720:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+70:12354:x1877767642766080:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 120us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779098.908728:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 196 00000100:00100000:3.0:1790779098.923842:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779098.923965:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642766208 00000100:00100000:0.0:1790779098.923975:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642766208 00000100:00100000:0.0:1790779098.924037:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:0.0:1790779098.924047:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:12354:x1877767642766208:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779098.924177:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779098.924212:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a5f expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.924245:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdbd50d0/0xb1aa4014e936d860 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a58 expref: 9 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.924255:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779098.924260:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779098.924265:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.924315:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bdbd50d0/0xb1aa4014e936d860 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a58 expref: 9 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.924328:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bdbd50d0/0xb1aa4014e936d860 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a58 expref: 9 pid: 8855 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779098.924342:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1877767663794176:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779098.924443:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81780 going to sleep for 11 seconds 00000100:00100000:0.0:1790779098.928681:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1877767663794176:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779098.928719:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.928740:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769c00, rc 0) 00000100:00100000:0.0:1790779098.928806:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+9:12354:x1877767642766208:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 4760us (4972us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779098.928815:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:3.0:1790779098.931565:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779098.934479:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642766336 00000100:00100000:0.0:1790779098.934495:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642766336 00010000:00010000:0.0:1790779098.934552:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bdbd50d0/0xb1aa4014e936d860 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a58 expref: 9 pid: 8855 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779098.934604:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:0.0:1790779098.934614:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2400:x1877767642766336:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779098.934647:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779098.934670:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdbd50d0/0xb1aa4014e936d860 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a58 expref: 9 pid: 8855 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.934684:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdbd50d0/0xb1aa4014e936d860 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a58 expref: 9 pid: 8855 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.934707:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdbd50d0/0xb1aa4014e936d860 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a58 expref: 9 pid: 8855 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.934725:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779098.934729:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779098.934737:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.934747:0:6509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.934792:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779098.934807:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1877767663794304:192.168.203.3@tcp:105: 00000100:00100000:0.0:1790779098.934962:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81780 going to sleep for 11 seconds 00000100:00100000:2.0:1790779098.963430:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1877767663794304:192.168.203.3@tcp:105: 00010000:00010000:2.0:1790779098.963458:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779098.963506:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2400:x1877767642766336:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 28892us (31949us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779098.963528:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:3.0:1790779098.963758:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779098.966122:0:14330:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642766464 00000100:00100000:2.0:1790779098.966137:0:14330:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642766464 00002000:00100000:2.0:1790779098.966311:0:14330:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9b76046e5c00 x1877767642766464/t0(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:649/0 lens 504/0 e 0 to 0 dl 1790779109 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779098.966323:0:14330:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76046e5c00 with x1877767642766464 ext(0->8) 00002000:00010000:2.0:1790779098.966329:0:14330:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76046e5c00 00000100:00100000:2.0:1790779098.966368:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:2.0:1790779098.966380:0:14330:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642766464:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790779098.967857:0:14330:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+10:2401:x1877767642766464:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 1472us (4094us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790779098.967870:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00002000:00100000:2.0:1790779098.967909:0:14330:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9b76046e5c00 x1877767642766464/t4294967315(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:649/0 lens 504/448 e 0 to 0 dl 1790779109 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790779098.967918:0:14330:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76046e5c00 with x1877767642766464 ext(0->8) 00002000:00010000:2.0:1790779098.967923:0:14330:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76046e5c00 00000100:00100000:3.0:1790779098.972471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779098.972723:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642766592 00000100:00100000:2.0:1790779098.972737:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642766592 00000100:00100000:2.0:1790779098.972801:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 197 00000100:00100000:2.0:1790779098.972811:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+70:12354:x1877767642766592:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790779098.979291:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1790779098.979319:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:2.0:1790779098.979349:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.979363:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.979371:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.979378:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779098.979383:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.979392:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790779098.979397:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:2.0:1790779098.979410:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b7712a96800) 00010000:00010000:2.0:1790779098.979415:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779098.979421:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790779098.979426:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b76030dc780 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:2.0:1790779098.979428:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936d58f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790779098.979432:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b771da33d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b76030dc540 00000020:00080000:3.0:1790779098.979436:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b771da33100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b760399fe00 00010000:00010000:2.0:1790779098.979466:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.979473:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.979481:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.979486:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3e00 already unused, calling callback (ffffffffc18564f0) 00000020:00080000:3.0:1790779098.979489:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:2.0:1790779098.979490:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.979499:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.979508:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:2.0:1790779098.979522:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779098.979525:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.979531:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936d596 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790779098.979707:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1790779098.979795:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779098.979816:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663794432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790779098.979917:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779098.979948:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663794432 00000100:00100000:3.0:1790779098.979957:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663794432 00000100:00100000:3.0:1790779098.980026:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790779098.980046:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663794432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790779098.980160:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790779098.980163:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790779098 00002000:00010000:3.0:1790779098.980166:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790779098.980168:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790779098 -> 1790779098 00002000:00010000:3.0:1790779098.980170:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1790779098.980215:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663794432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (297us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790779098.980222:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:3.0:1790779098.980264:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76045f9c00/2, rc 0, transno 4294967316 00000100:00100000:3.0:1790779098.980271:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663794432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790779098.980420:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779098.980430:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663794560:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790779098.980460:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779098.980502:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663794560 00000100:00100000:1.0:1790779098.980506:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663794560 00010000:00010000:2.0:1790779098.981193:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981202:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981210:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779098.981424:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790779098.981439:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663794560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790779098.981470:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1790779098.981496:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6abd1ed7, atime: 0x6abd1ed8, ctime: 0x6abd1ed7, blocks: 0x8 00010000:00010000:1.0:1790779098.981503:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d86e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.981528:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1790779098.981532:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779098.981538:0:8438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981681:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779098.981686:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981695:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981708:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7712a96c00) 00010000:00010000:2.0:1790779098.981711:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779098.981716:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981723:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d5d5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981746:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981753:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981759:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981764:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779098.981767:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981774:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981793:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:2.0:1790779098.981796:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779098.981799:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981806:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d6d8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981817:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981824:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981830:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981836:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779098.981839:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981846:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981852:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:2.0:1790779098.981855:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779098.981858:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981864:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d6fb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981903:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981910:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981915:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981920:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779098.981923:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981928:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981935:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:2.0:1790779098.981937:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779098.981939:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981945:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d741 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981955:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981963:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981969:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981980:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779098.981984:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.981990:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.982008:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:2.0:1790779098.982010:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790779098.982013:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779098.982020:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d844 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790779098.982193:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790779098.982198:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790779098.982423:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.982433:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.982440:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779098.982465:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790779098.983439:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1877767663794560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2000us (2971us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790779098.983450:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790779098.983824:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+19:12354:x1877767642766592:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 11013us (11361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779098.983832:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 197 00010000:00010000:0.0:1790779098.983916:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779098.983926:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.983937:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779098.983942:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.983953:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d86e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.983973:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d86e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.983980:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d86e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779098.984010:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779098.984012:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779098.984014:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790779098.984607:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76046ced80/2, rc 0, transno 4294967308 00000100:00100000:1.0:1790779098.984616:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663794560:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790779098.996378:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779098.997301:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642766720 00000100:00100000:3.0:1790779098.997312:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642766720 00000100:00100000:2.0:1790779099.014759:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1790779099.014772:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+10:2399:x1877767642766720:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790779099.023911:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1790779099.023924:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1790779099.024694:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2399:x1877767642766720:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 9919us (28318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779099.024706:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:1.0:1790779099.033743:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779099.033849:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642766976 00000100:00100000:0.0:1790779099.033858:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642766976 00000100:00100000:0.0:1790779099.034057:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 198 00000100:00100000:0.0:1790779099.034085:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+19:12354:x1877767642766976:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790779099.034154:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779099.034181:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d859 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a51 expref: 19 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.034328:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:0.0:1790779099.034334:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790779099.034363:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.034377:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.034388:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790779099.034507:0:6525:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fc8a5248 reply state 00000000034715fa transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.034520:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.034526:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:0.0:1790779099.034529:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790779099.034531:0:6525:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790779099.034697:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+20:12354:x1877767642766976:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 621us (963us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1790779099.034705:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 198 00000100:00080000:2.0:1790779099.035512:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779099.053341:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779099.053415:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642767104 00000100:00100000:2.0:1790779099.053426:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642767104 00000100:00100000:2.0:1790779099.053491:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1790779099.053501:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642767104:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790779099.053669:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790779099.053673:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790779098 -> 1790779097 00002000:00010000:2.0:1790779099.053676:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790779096 00002000:00010000:2.0:1790779099.053679:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790779098 -> 1790779097 00002000:00010000:2.0:1790779099.053681:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1790779099.053737:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2400:x1877767642767104:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 238us (404us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1790779099.053745:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:1.0:1790779099.062518:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779099.062596:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642767360 00000100:00100000:0.0:1790779099.062606:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642767360 00000100:00100000:0.0:1790779099.062670:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 199 00000100:00100000:0.0:1790779099.062681:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+20:12354:x1877767642767360:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790779099.062756:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.062774:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d83d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a43 expref: 20 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.062783:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.062817:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d83d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a43 expref: 20 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.062831:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d83d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a43 expref: 20 pid: 13003 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.062846:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663794688:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779099.062960:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779099.072504:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779099.072780:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663794688:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779099.072806:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.072954:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642767488 00000100:00100000:0.0:1790779099.072961:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642767488 00010000:00010000:0.0:1790779099.072996:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d83d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a43 expref: 21 pid: 13003 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.073029:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 86 00000100:00100000:0.0:1790779099.073038:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+21:2401:x1877767642767488:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779099.073052:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779099.073072:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d83d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a43 expref: 21 pid: 13003 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073084:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d83d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a43 expref: 21 pid: 13003 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073105:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d83d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a43 expref: 21 pid: 13003 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073117:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:0.0:1790779099.073122:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073132:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073139:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073163:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779099.073210:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+20:2401:x1877767642767488:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 173us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779099.073218:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 86 00010000:00010000:0.0:1790779099.073243:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073250:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073283:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073297:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073303:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073309:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779099.073313:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073320:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073328:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:0.0:1790779099.073331:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790779099.073335:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.073341:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d87c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.073381:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+19:12354:x1877767642767360:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 10703us (10872us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790779099.073478:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 199 00000100:00100000:1.0:1790779099.077127:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779099.077401:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642767616 00000100:00100000:3.0:1790779099.077410:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642767616 00000100:00100000:3.0:1790779099.077465:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1790779099.077474:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2398:x1877767642767616:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790779099.077512:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.077533:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.077542:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790779099.077546:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790779099.077551:0:8438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.077580:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.077594:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 8 pid: 8440 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779099.077607:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1877767663794816:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779099.077672:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779099.085239:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779099.085305:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642767744 00000100:00100000:0.0:1790779099.085314:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642767744 00010000:00010000:0.0:1790779099.085349:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 9 pid: 8440 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.085388:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:0.0:1790779099.085408:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff62050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2398:x1877767642767744:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779099.085421:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779099.085440:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 9 pid: 8440 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.085453:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 9 pid: 8440 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.085477:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790779099.085482:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790779099.085488:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.085498:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.085517:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779099.085562:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff62050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2398:x1877767642767744:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 155us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779099.085569:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 87 00010000:00010000:3.0:1790779099.086479:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f589b23f/0xb1aa4014e936d867 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a5f expref: 8 pid: 8440 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779099.086509:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1877767663794816:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779099.086529:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.086539:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.086546:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.086567:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.086576:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.086584:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.086592:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779099.086597:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.086605:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.086626:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.086635:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936d883 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779099.086685:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2398:x1877767642767616:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 9211us (9564us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779099.086693:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:1.0:1790779099.103794:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779099.103869:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642768000 00000100:00100000:0.0:1790779099.103903:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642768000 00000100:00100000:0.0:1790779099.103949:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 200 00000100:00100000:0.0:1790779099.103958:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+19:12354:x1877767642768000:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790779099.104033:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.104073:0:13003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d6d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e8 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.104084:0:13003:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.104119:0:13003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e8 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.104134:0:13003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d6d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e8 expref: 19 pid: 6524 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.104148:0:13003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13003:1877767663794944:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779099.104227:0:13003:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790779099.112237:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779099.120946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779099.120970:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642768128 00000100:00100000:0.0:1790779099.120978:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642768128 00010000:00010000:0.0:1790779099.121015:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d6d1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e8 expref: 20 pid: 6524 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.121044:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:0.0:1790779099.121053:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+20:2401:x1877767642768128:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779099.121076:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779099.121084:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d6d1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e8 expref: 20 pid: 6524 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.121096:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d6d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e8 expref: 20 pid: 6524 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.121125:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:0.0:1790779099.121130:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.121141:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.121149:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.121164:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779099.121207:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+20:2401:x1877767642768128:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 154us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779099.121214:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 88 00010000:00010000:1.0:1790779099.126870:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d6d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b4259e8 expref: 19 pid: 6524 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779099.127292:0:13003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13003:1877767663794944:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779099.127317:0:13003:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.127328:0:13003:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.127334:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.127508:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.127522:0:13003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d84b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a4a expref: 19 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.127531:0:13003:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.127563:0:13003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d84b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a4a expref: 19 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.127579:0:13003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d84b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a4a expref: 19 pid: 13821 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779099.127604:0:13003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13003:1877767663795072:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779099.127691:0:13003:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76035bd180 going to sleep for 11 seconds 00000100:00100000:1.0:1790779099.132483:0:13003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13003:1877767663795072:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779099.132511:0:13003:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.132919:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779099.133176:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642768256 00000100:00100000:1.0:1790779099.133184:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642768256 00010000:00010000:1.0:1790779099.133219:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d84b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a4a expref: 20 pid: 13821 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779099.133258:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:1.0:1790779099.133271:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+20:2400:x1877767642768256:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779099.133284:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779099.133291:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d84b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a4a expref: 20 pid: 13821 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.133303:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d84b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a4a expref: 20 pid: 13821 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.133324:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d84b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a4a expref: 20 pid: 13821 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.133338:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:1.0:1790779099.133343:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.133364:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.133372:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.133393:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779099.133432:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+19:2400:x1877767642768256:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 166us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779099.133439:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 89 00010000:00010000:3.0:1790779099.133563:0:13003:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.133571:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790779099.133676:0:13003:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1790779099.134184:0:13003:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1790779099.136743:0:13003:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1790779099.136864:0:13003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13003:1877767663795200:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1790779099.136944:0:13003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779099.136975:0:13003:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c900 going to sleep for 11 seconds 00000100:00100000:1.0:1790779099.137567:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663795200 00000100:00100000:1.0:1790779099.137574:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663795200 00000100:00100000:1.0:1790779099.137618:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790779099.137626:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13003:x1877767663795200:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1790779099.137705:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13003:x1877767663795200:12345-0@lo:1000:mdt00_004.0 Request processed in 79us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779099.137712:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1790779099.142112:0:13003:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1790779099.142123:0:13003:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76045f9c00, transno 4294967316 00000100:00100000:3.0:1790779099.142153:0:13003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13003:1877767663795200:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1790779099.142313:0:13003:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1790779099.142398:0:13003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13003:1877767663795328:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1790779099.142472:0:13003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779099.142499:0:13003:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779099.142706:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663795328 00000100:00100000:2.0:1790779099.142714:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663795328 00000100:00100000:2.0:1790779099.142924:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790779099.142934:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13003:x1877767663795328:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1790779099.144201:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13003:x1877767663795328:12345-0@lo:1000:mdt00_004.0 Request processed in 1263us (1724us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790779099.144212:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1790779099.148501:0:13003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13003:1877767663795328:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1790779099.148564:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148575:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148582:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148588:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779099.148593:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148621:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148637:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:0.0:1790779099.148640:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790779099.148645:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148651:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7a00/0xb1aa4014e936d891 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148676:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d7c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148682:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d7c6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148688:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d7c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148693:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779099.148695:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d7c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148700:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d7c6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148707:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:0.0:1790779099.148710:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790779099.148712:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d7c6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148728:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d7c6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148750:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148765:0:13003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a2e expref: 22 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148774:0:13003:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148810:0:13003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a2e expref: 22 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.148825:0:13003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a2e expref: 22 pid: 13821 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.148838:0:13003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13003:1877767663795456:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779099.148951:0:13003:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779099.161067:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779099.161851:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642768384 00000100:00100000:0.0:1790779099.161861:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642768384 00010000:00010000:0.0:1790779099.161914:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a2e expref: 23 pid: 13821 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.161944:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:0.0:1790779099.161953:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+23:2401:x1877767642768384:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779099.161990:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779099.161997:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a2e expref: 23 pid: 13821 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.162011:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a2e expref: 23 pid: 13821 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.162181:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:0.0:1790779099.162188:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.162199:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.162206:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.162226:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779099.162282:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+23:2401:x1877767642768384:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 329us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779099.162291:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 90 00010000:00010000:1.0:1790779099.168437:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d7e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a2e expref: 22 pid: 13821 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779099.168460:0:13003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13003:1877767663795456:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779099.168484:0:13003:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169022:0:13003:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169039:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169066:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169073:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169081:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169087:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779099.169090:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169098:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169113:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779099.169117:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779099.169121:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169127:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d898 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169137:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169143:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169148:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169157:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779099.169161:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169167:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169173:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7000) 00010000:00010000:1.0:1790779099.169175:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790779099.169178:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.169183:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936d88a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779099.169350:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+21:12354:x1877767642768000:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 65391us (65562us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1790779099.169359:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 200 00000020:00080000:1.0:1790779099.169365:0:13003:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790779099.169609:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790779099.169614:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790779099.170119:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790779099.170130:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790779099.181274:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779099.181338:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642768640 00000100:00100000:3.0:1790779099.181348:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642768640 00000100:00100000:3.0:1790779099.181404:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1790779099.181415:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718266050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+21:12354:x1877767642768640:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790779099.181651:0:6527:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790779099.181687:0:6527:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1790779099.181719:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d89f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.181734:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d89f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.181745:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d89f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.181753:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d89f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.181759:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d89f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.181765:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d89f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.181805:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790779099.181911:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718266050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+23:12354:x1877767642768640:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 498us (653us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1790779099.181918:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000020:00080000:3.0:1790779099.181923:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790779099.185699:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779099.185713:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d89f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.185725:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779099.185730:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d89f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.185740:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d89f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.185775:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:1.0:1790779099.185778:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790779099.185783:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d89f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.185789:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d89f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.185806:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779099.185808:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779099.185809:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779099.240181:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663795584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779099.240265:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779099.240474:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663795584 00000100:00100000:3.0:1790779099.240484:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663795584 00000100:00100000:3.0:1790779099.240533:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790779099.240557:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663795584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790779099.240581:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1790779099.240639:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663795584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779099.240646:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790779099.240698:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663795584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779099.241178:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779099.241191:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663795712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779099.241236:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779099.241312:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663795712 00000100:00100000:0.0:1790779099.241317:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663795712 00000100:00100000:0.0:1790779099.241373:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790779099.241381:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663795712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779099.241394:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1790779099.241446:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663795712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779099.241471:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1790779099.241710:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779099.241743:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663795712:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1790779099.511811:0:14661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790779099.511821:0:14661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790779099.511873:0:14661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1790779099.511912:0:14661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790779099.694196:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779099.697218:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642768896 00000100:00100000:3.0:1790779099.697234:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642768896 00000100:00100000:3.0:1790779099.697312:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00100000:3.0:1790779099.697323:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+23:12364:x1877767642768896:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779099.697349:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779099.697371:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a66 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.697474:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d8ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.697503:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d8ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.697515:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d8ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779099.697527:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790779099.697626:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a66 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.697644:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d8ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a66 expref: 25 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.697652:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779099.697655:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790779099.697658:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663800, rc 0) 00000100:00100000:3.0:1790779099.697728:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+25:12364:x1877767642768896:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 406us (3543us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1790779099.697735:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00100000:3.0:1790779099.700263:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779099.705823:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642769024 00000100:00100000:0.0:1790779099.705839:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642769024 00000100:00100000:0.0:1790779099.706471:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:0.0:1790779099.706483:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+25:12364:x1877767642769024:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:0.0:1790779099.706566:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706584:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706595:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706612:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d8c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706620:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706626:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706700:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d8c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706708:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706714:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790779099.706778:0:13821:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706791:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706797:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706802:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706807:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779099.706811:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706818:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706829:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:0.0:1790779099.706831:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779099.706836:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706842:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706854:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706860:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d8c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706873:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706899:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779099.706902:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706909:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d8c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706916:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7603616800) 00010000:00010000:0.0:1790779099.706918:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779099.706921:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d8c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706927:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d8c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706941:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706946:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d8c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706951:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d8c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706957:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779099.706960:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d8c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706986:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d8c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.706995:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b7603616300) 00010000:00010000:0.0:1790779099.706997:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779099.707001:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d8c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.707006:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936d8c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.707090:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+25:12364:x1877767642769024:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 610us (6836us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779099.707098:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:0.0:1790779099.745380:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779099.747764:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642769280 00000100:00100000:1.0:1790779099.747780:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642769280 00000100:00100000:1.0:1790779099.747844:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:1.0:1790779099.747854:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+25:12367:x1877767642769280:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779099.747875:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779099.747914:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d8d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a6d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.747989:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d8d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748004:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748029:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748045:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d8de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748052:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d8de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748067:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d8de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748176:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d8e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748185:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748192:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779099.748201:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790779099.748272:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748280:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d8d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748287:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748292:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779099.748301:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748309:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d8d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748321:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:1.0:1790779099.748324:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779099.748342:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d8d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748348:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936d8d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748360:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d8de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748365:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d8de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748371:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d8de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748376:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779099.748379:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d8de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748384:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d8de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748391:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b76026e7000) 00010000:00010000:1.0:1790779099.748394:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779099.748403:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d8de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748410:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936d8de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748447:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936d8d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a6d expref: 28 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748460:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a6d expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.748468:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:1.0:1790779099.748470:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779099.748472:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7400, rc 0) 00000100:00100000:1.0:1790779099.748787:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+27:12367:x1877767642769280:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 933us (3415us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1790779099.748795:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:0.0:1790779099.753950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779099.754436:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642769408 00000100:00100000:3.0:1790779099.754446:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642769408 00000100:00100000:3.0:1790779099.754511:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 204 00000100:00100000:3.0:1790779099.754521:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+27:12367:x1877767642769408:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:3.0:1790779099.754737:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.754756:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.754779:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.754815:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.754823:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.754831:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.754838:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779099.754842:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.754850:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.754862:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:3.0:1790779099.754865:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790779099.754870:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.754994:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d8f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779099.755086:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+27:12367:x1877767642769408:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 566us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779099.755095:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 204 00000100:00100000:0.0:1790779099.767477:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779099.767805:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642769664 00000100:00100000:1.0:1790779099.767815:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642769664 00000100:00100000:1.0:1790779099.767899:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:1.0:1790779099.767910:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+27:12367:x1877767642769664:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:1.0:1790779099.768138:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+28:12367:x1877767642769664:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 229us (668us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1790779099.768145:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:0.0:1790779099.818345:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779099.818387:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642769920 00000100:00100000:0.0:1790779099.818398:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642769920 00000100:00100000:0.0:1790779099.818451:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 205 00000100:00100000:0.0:1790779099.818461:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+28:11900:x1877767642769920:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1790779099.818486:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779099.818506:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a74 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.820782:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.820825:0:13821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a6d expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.820835:0:13821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.820870:0:13821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a6d expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779099.820901:0:13821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a6d expref: 29 pid: 6524 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779099.820917:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663795840:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779099.821023:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c300 going to sleep for 11 seconds 00000100:00100000:0.0:1790779099.829591:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779099.829650:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13821:1877767663795840:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779099.829676:0:13821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779099.834193:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642770048 00000100:00100000:1.0:1790779099.834209:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642770048 00010000:00010000:1.0:1790779099.834259:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a6d expref: 30 pid: 6524 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779099.834318:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:1.0:1790779099.834329:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+30:2400:x1877767642770048:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779099.834345:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779099.834351:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a6d expref: 30 pid: 6524 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.834363:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a6d expref: 30 pid: 6524 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.834384:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936d8e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a6d expref: 30 pid: 6524 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.834401:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:1.0:1790779099.834406:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.834415:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.834422:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.834446:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779099.834505:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+29:2400:x1877767642770048:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 178us (4923us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779099.834512:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 91 00010000:00010000:1.0:1790779099.834718:0:13821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.834732:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779099.834751:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790779099.834863:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d8fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a74 expref: 30 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.834896:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a74 expref: 29 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779099.834904:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:1.0:1790779099.834907:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790779099.834909:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769800, rc 0) 00000100:00100000:1.0:1790779099.834933:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11900:x1877767642769920:12345-192.168.203.3@tcp:101:bash.0 Request processed in 16474us (16608us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1790779099.834939:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 205 00000100:00100000:3.0:1790779099.843251:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779099.843646:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642770176 00000100:00100000:2.0:1790779099.843655:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642770176 00000100:00100000:2.0:1790779099.843708:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 206 00000100:00100000:2.0:1790779099.843719:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+29:11900:x1877767642770176:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1790779099.843750:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779099.843770:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d90f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a7b expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.843804:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d916 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.843819:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.843831:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.843953:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b600/0xb1aa4014e936d90f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a7b expref: 31 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.843971:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d916 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a7b expref: 30 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.843979:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:2.0:1790779099.843982:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790779099.843986:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894ae00, rc 0) 00000100:00100000:2.0:1790779099.844046:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11900:x1877767642770176:12345-192.168.203.3@tcp:101:bash.0 Request processed in 329us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779099.844067:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 206 00000100:00100000:2.0:1790779099.852448:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779099.852492:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642770432 00000100:00100000:2.0:1790779099.852502:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642770432 00000100:00100000:2.0:1790779099.852683:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 207 00000100:00100000:2.0:1790779099.852703:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+30:11900:x1877767642770432:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:2.0:1790779099.852971:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.852989:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.853000:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790779099.854204:0:10428:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1790779099.854246:0:10428:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ac113329 reply state 0000000014704584 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.854264:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.854273:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:2.0:1790779099.854276:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779099.854280:0:10428:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1790779099.855472:0:10428:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1790779099.856237:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+34:11900:x1877767642770432:12345-192.168.203.3@tcp:36:bash.0 Request processed in 3528us (3790us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1790779099.856247:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 207 00000020:00080000:2.0:1790779099.856253:0:10428:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1790779099.868448:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779099.868486:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642770560 00000100:00100000:3.0:1790779099.868495:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642770560 00000100:00100000:3.0:1790779099.870198:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 208 00000100:00100000:3.0:1790779099.870216:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+34:11900:x1877767642770560:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779099.870239:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779099.870258:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d924 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a82 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.870316:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d924 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a82 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.870330:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d924 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a82 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779099.870351:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:3.0:1790779099.870355:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790779099.870358:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663600, rc 0) 00000100:00100000:3.0:1790779099.870418:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+35:11900:x1877767642770560:12345-192.168.203.3@tcp:101:bash.0 Request processed in 209us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779099.870425:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 208 00000100:00100000:1.0:1790779099.874995:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779099.875075:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642770688 00000100:00100000:2.0:1790779099.875084:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642770688 00000100:00100000:2.0:1790779099.875140:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:2.0:1790779099.875154:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:11900:x1877767642770688:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1790779099.875171:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779099.875199:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936d92b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a89 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779099.875225:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6abd1ed9, atime: 0x6abd1ed8, ctime: 0x6abd1ed9, blocks: 0x8 00010000:00010000:2.0:1790779099.875247:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=417s v=(0 0) 00010000:00010000:2.0:1790779099.875251:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779099.875260:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936d92b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a89 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.875275:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936d92b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a89 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779099.875285:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b600, rc 0) 00000100:00100000:2.0:1790779099.875336:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:11900:x1877767642770688:12345-192.168.203.3@tcp:101:bash.0 Request processed in 188us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779099.875343:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:3.0:1790779099.887713:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779099.889151:0:8445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642770816 00000100:00100000:0.0:1790779099.889164:0:8445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642770816 00002000:00010000:0.0:1790779099.889207:0:8445:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1790779099.889212:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76046e5880 with x1877767642770816 ext(0->18446744073709551615) 00002000:00010000:0.0:1790779099.889223:0:8445:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76046e5880. 00000100:00100000:0.0:1790779099.889255:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1790779099.889266:0:8445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642770816:12345-192.168.203.3@tcp:10:bash.0 00002000:00010000:0.0:1790779099.889516:0:8445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790779099.889520:0:8445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790779097 -> 1790779099 00002000:00010000:0.0:1790779099.889523:0:8445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1790779096 -> 1790779096 00002000:00010000:0.0:1790779099.889525:0:8445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790779097 -> 1790779099 00002000:00010000:0.0:1790779099.889527:0:8445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1790779099.889854:0:8445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2401:x1877767642770816:12345-192.168.203.3@tcp:10:bash.0 Request processed in 588us (2150us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1790779099.889863:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00002000:00010000:0.0:1790779099.889867:0:8445:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1790779099.889870:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76046e5880 with x1877767642770816 ext(0->18446744073709551615) 00002000:00010000:0.0:1790779099.889875:0:8445:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76046e5880. 00000100:00100000:3.0:1790779100.005226:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779100.009754:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642770944 00000100:00100000:2.0:1790779100.009770:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642770944 00000100:00100000:2.0:1790779100.009851:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 209 00000100:00100000:2.0:1790779100.009862:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+35:12381:x1877767642770944:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:2.0:1790779100.009980:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d932 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.009999:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d932 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.010011:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d932 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.010041:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d939 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.010049:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.010070:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010200:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d940 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010210:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010230:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779100.010272:0:13003:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010283:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d932 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010290:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d932 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010297:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d932 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010303:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779100.010307:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d932 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010314:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d932 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010325:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779100.010339:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779100.010345:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d932 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010351:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d932 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010364:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010376:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d939 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010382:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010387:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779100.010390:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010396:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d939 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010404:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7712a96300) 00010000:00010000:3.0:1790779100.010406:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779100.010409:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d939 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010414:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d939 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010431:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010436:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d940 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010441:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d940 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010445:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779100.010453:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d940 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010459:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d940 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010466:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:3.0:1790779100.010468:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779100.010471:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d940 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.010477:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d940 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779100.010557:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+35:12381:x1877767642770944:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 696us (5338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779100.010565:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 209 00000100:00100000:2.0:1790779100.062314:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779100.062728:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642771200 00000100:00100000:0.0:1790779100.062738:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642771200 00000100:00100000:0.0:1790779100.062801:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 210 00000100:00100000:0.0:1790779100.062812:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+35:12384:x1877767642771200:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1790779100.062834:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779100.062854:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d947 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a90 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.062952:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d94e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.062968:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d94e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.062980:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d94e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063013:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d955 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063020:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063154:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063250:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d95c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063260:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d95c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063268:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d95c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779100.063278:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790779100.063351:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d94e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063360:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d94e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063368:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d94e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063373:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779100.063378:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d94e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063396:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d94e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063408:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:0.0:1790779100.063412:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779100.063417:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d94e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063424:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936d94e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063437:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063443:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d955 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063450:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d955 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063455:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779100.063458:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d955 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063465:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d955 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063472:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7603616300) 00010000:00010000:0.0:1790779100.063475:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779100.063478:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d955 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063492:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936d955 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.063531:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936d947 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a90 expref: 38 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.065027:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d95c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a90 expref: 37 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.065040:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:0.0:1790779100.065043:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790779100.065047:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769c00, rc 0) 00000100:00100000:0.0:1790779100.065150:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+37:12384:x1877767642771200:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 2338us (2842us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1790779100.065159:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 210 00000100:00100000:0.0:1790779100.075827:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779100.075990:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642771328 00000100:00100000:3.0:1790779100.076001:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642771328 00000100:00100000:3.0:1790779100.076061:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00100000:3.0:1790779100.076071:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+37:12384:x1877767642771328:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:3.0:1790779100.076135:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.076151:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a74 expref: 37 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.076161:0:6523:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.076192:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a74 expref: 37 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.076219:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a74 expref: 37 pid: 13821 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779100.076235:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663795968:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779100.076344:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c000 going to sleep for 11 seconds 00000100:00100000:3.0:1790779100.079854:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1877767663795968:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779100.079924:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779100.083655:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779100.083917:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642771584 00000100:00100000:1.0:1790779100.083926:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642771584 00000100:00100000:1.0:1790779100.083994:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:1.0:1790779100.084004:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+38:6167:x1877767642771584:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790779100.084323:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+39:6167:x1877767642771584:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 320us (676us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1790779100.084341:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:1.0:1790779100.088701:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779100.089190:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642771712 00000100:00100000:3.0:1790779100.089201:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642771712 00010000:00010000:3.0:1790779100.089242:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a74 expref: 39 pid: 13821 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779100.089285:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:3.0:1790779100.089295:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+39:2401:x1877767642771712:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779100.089310:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779100.089316:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a74 expref: 39 pid: 13821 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.089341:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a74 expref: 39 pid: 13821 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.089366:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936d901 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a74 expref: 39 pid: 13821 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.089401:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:3.0:1790779100.089407:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.089418:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.089426:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.089461:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779100.089524:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+38:2401:x1877767642771712:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 231us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779100.089532:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 92 00010000:00010000:1.0:1790779100.090170:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.090189:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.090229:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.090236:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.090242:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.090247:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779100.090251:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.090258:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.090269:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:1.0:1790779100.090271:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790779100.090275:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.090280:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d96a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779100.090350:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+38:12384:x1877767642771328:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 14279us (14532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779100.090358:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00100000:1.0:1790779100.094592:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779100.094715:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642771968 00000100:00100000:3.0:1790779100.094726:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642771968 00000100:00100000:3.0:1790779100.094835:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:3.0:1790779100.094844:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+37:12384:x1877767642771968:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779100.095125:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+38:12384:x1877767642771968:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 281us (542us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1790779100.095133:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00010000:00010000:0.0:1790779100.136649:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779100.214857:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779100.215338:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642772224 00000100:00100000:3.0:1790779100.215348:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642772224 00000100:00100000:3.0:1790779100.215444:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00100000:3.0:1790779100.215455:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+38:12395:x1877767642772224:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:3.0:1790779100.215478:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779100.215510:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d971 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a97 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215596:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d978 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215610:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d978 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215620:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d978 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215633:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d97f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215640:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d97f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215646:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d97f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215765:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d986 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215775:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215781:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779100.215791:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1790779100.215906:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d978 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215924:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d978 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215931:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d978 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215937:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779100.215941:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d978 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215948:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d978 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215959:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779100.215962:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779100.215967:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d978 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215984:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d978 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.215998:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d97f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.216004:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d97f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.216010:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d97f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.216015:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779100.216036:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d97f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.216042:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d97f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.216058:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7704171b00) 00010000:00010000:3.0:1790779100.216061:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779100.216064:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d97f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.216070:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d97f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.216112:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d971 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a97 expref: 41 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.216126:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d986 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a97 expref: 40 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.216133:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:3.0:1790779100.216136:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779100.216138:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662c00, rc 0) 00000100:00100000:3.0:1790779100.216210:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+40:12395:x1877767642772224:12345-192.168.203.3@tcp:101:cat.0 Request processed in 757us (1362us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1790779100.217183:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00100000:2.0:1790779100.226147:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779100.231347:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642772480 00000100:00100000:0.0:1790779100.231364:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642772480 00000100:00100000:0.0:1790779100.237905:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:0.0:1790779100.237931:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+40:12395:x1877767642772480:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:0.0:1790779100.239260:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+41:12395:x1877767642772480:12345-192.168.203.3@tcp:35:cat.0 Request processed in 1335us (13114us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1790779100.239272:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:3.0:1790779100.264251:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779100.264273:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663796096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779100.264345:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779100.264381:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663796096 00000100:00100000:1.0:1790779100.264390:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663796096 00000100:00100000:1.0:1790779100.264443:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790779100.264453:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663796096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790779100.264483:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779100.264541:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663796096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779100.264548:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790779100.264726:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663796096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779100.264916:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663796224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779100.264949:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779100.265061:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663796224 00000100:00100000:1.0:1790779100.265066:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663796224 00000100:00100000:1.0:1790779100.265100:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790779100.265107:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1877767663796224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790779100.265119:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779100.265151:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1877767663796224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779100.265157:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790779100.265420:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663796224:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790779100.265670:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779100.265803:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663796608:0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.265840:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779100.265864:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663797120:0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.265912:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779100.265931:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663797632:0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.265952:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779100.265974:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790779100.265980:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663796480:0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266013:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779100.266041:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663796992:0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266074:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779100.266090:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663797504:0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266111:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779100.266156:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663796608 00000100:00100000:2.0:1790779100.266161:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663796608 00000100:00100000:2.0:1790779100.266199:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790779100.266207:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663796608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266259:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663796608:12345-0@lo:400:kworker.0 Request processed in 52us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779100.266267:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790779100.266290:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663797120 00000100:00100000:2.0:1790779100.266295:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663797120 00000100:00100000:2.0:1790779100.266323:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663797632 00000100:00100000:2.0:1790779100.266326:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663797632 00000100:00100000:2.0:1790779100.266338:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663796480 00000100:00100000:2.0:1790779100.266340:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663796480 00000100:00100000:2.0:1790779100.266349:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663796992 00000100:00100000:2.0:1790779100.266351:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663796992 00000100:00100000:2.0:1790779100.266363:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663797504 00000100:00100000:2.0:1790779100.266365:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663797504 00000100:00100000:2.0:1790779100.266378:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1790779100.266383:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663797120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266413:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663797120:12345-0@lo:400:kworker.0 Request processed in 29us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779100.266419:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1790779100.266430:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1790779100.266436:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663797632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266460:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663797632:12345-0@lo:400:kworker.0 Request processed in 25us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779100.266465:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1790779100.266475:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1790779100.266480:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663796480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266514:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663796480:12345-0@lo:400:kworker.0 Request processed in 34us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779100.266520:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1790779100.266532:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1790779100.266539:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663796992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266563:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663796992:12345-0@lo:400:kworker.0 Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779100.266569:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1790779100.266580:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1790779100.266585:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663797504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266608:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663797504:12345-0@lo:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779100.266614:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00080000:2.0:1790779100.266628:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779100.266632:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779100.266653:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663796480:0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266663:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663796992:0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266670:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663797504:0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.266678:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663796608:0@lo:400:kworker.0 00010000:00080000:2.0:1790779100.266689:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b772fe27b80 x1877767663797120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779100.266699:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663797120:0@lo:400:kworker.0 00010000:00080000:2.0:1790779100.266707:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603bec000 x1877767663797632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779100.266722:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663797632:0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267105:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663796736:0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267143:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779100.267175:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663797248:0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267200:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779100.267219:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790779100.267225:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663796352:0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267254:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779100.267278:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663796864:0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267301:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779100.267319:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663797376:0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267342:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779100.267374:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663796352 00000100:00100000:3.0:1790779100.267380:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663796352 00000100:00100000:3.0:1790779100.267414:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1790779100.267421:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663796352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267462:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663796352:12345-0@lo:400:kworker.0 Request processed in 40us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779100.267468:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1790779100.267495:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663797248 00000100:00100000:3.0:1790779100.267499:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663797248 00000100:00100000:3.0:1790779100.267522:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663797376 00000100:00100000:3.0:1790779100.267534:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663797376 00000100:00100000:3.0:1790779100.267565:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790779100.267571:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663797248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267601:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663797248:12345-0@lo:400:kworker.0 Request processed in 32us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779100.267606:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790779100.267617:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790779100.267622:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663797376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267647:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663797376:12345-0@lo:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779100.267652:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1790779100.267668:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779100.267678:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663796864 00000100:00100000:3.0:1790779100.267682:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663796864 00000100:00100000:3.0:1790779100.267704:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790779100.267709:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663796864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267741:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663796864:12345-0@lo:400:kworker.0 Request processed in 32us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779100.267747:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790779100.267781:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663796352:0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267792:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663796864:0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267801:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663797376:0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267809:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663797248:0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267840:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663796736 00000100:00100000:3.0:1790779100.267844:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663796736 00000100:00100000:3.0:1790779100.267874:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1790779100.267914:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663796736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779100.267952:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663796736:12345-0@lo:400:kworker.0 Request processed in 72us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779100.267957:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1790779100.267981:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663796736:0@lo:400:kworker.0 00000100:00100000:2.0:1790779100.273705:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779100.273800:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642772736 00000100:00100000:1.0:1790779100.273812:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642772736 00000100:00100000:1.0:1790779100.273872:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 213 00000100:00100000:1.0:1790779100.273957:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760384d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+41:12396:x1877767642772736:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:1.0:1790779100.274138:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1790779100.274168:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663600/0xb1aa4014e936d924 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a82 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274190:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936d986 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a97 expref: 40 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274223:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936d95c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a90 expref: 39 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274235:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d916 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a7b expref: 38 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274246:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:1.0:1790779100.274251:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779100.274273:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d994 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274285:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d994 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274295:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d994 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274308:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274314:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274320:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274401:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d9a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274410:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d9a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274424:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d9a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779100.274642:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1790779100.274653:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418281772134ns, next at 419281769364ns, rc = 0 00010000:00010000:1.0:1790779100.274702:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d9a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274712:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d9a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274720:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d9a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274727:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d9a9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274733:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d9a9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.274738:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d9a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275687:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790779100.275721:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d9a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275730:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d9a2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275737:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d9a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275757:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779100.275789:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d9a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275798:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d9a2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275812:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:1.0:1790779100.275816:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790779100.275820:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d9a2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275827:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936d9a2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275846:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d994 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275851:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d994 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275856:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d994 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275861:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779100.275864:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d994 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275869:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d994 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275909:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:1.0:1790779100.275911:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779100.275915:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d994 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275920:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936d994 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790779100.275930:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070619132 reply state 000000000926e9b3 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275940:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.275947:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b76026e7000) 00010000:00010000:1.0:1790779100.275948:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779100.275951:0:6524:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779100.276046:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760384d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+39:12396:x1877767642772736:12345-192.168.203.3@tcp:36:rm.0 Request processed in 2163us (2350us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1790779100.276064:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 213 00010000:00010000:2.0:1790779100.279165:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779100.279178:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d9a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.279190:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779100.279195:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d9a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.279205:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d9a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.279222:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:2.0:1790779100.279225:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790779100.279230:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d9a9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.279236:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936d9a9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.279253:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779100.279255:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779100.279257:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779100.336170:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779100.336472:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642772992 00000100:00100000:3.0:1790779100.336482:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642772992 00000100:00100000:3.0:1790779100.336594:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 214 00000100:00100000:3.0:1790779100.336605:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+39:12402:x1877767642772992:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779100.336629:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779100.336651:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d9b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425a9e expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.336753:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d9b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.336768:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d9b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.336779:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d9b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.336789:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.336796:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.336802:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790779100.338457:0:13003:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1790779100.339425:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d9c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.339443:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.339455:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.339492:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d9b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.339500:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d9b7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.339507:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d9b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.339513:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779100.339517:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d9b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.339525:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d9b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.340131:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779100.340136:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779100.340141:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d9b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.340165:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936d9b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779100.340947:0:13003:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000be4f20e1 reply state 00000000f5018190 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.340964:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.340972:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b76026e7000) 00010000:00010000:3.0:1790779100.340975:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790779100.340978:0:13003:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790779100.341146:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936d9b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a9e expref: 42 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.341165:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a9e expref: 41 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.341172:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7704171b00) 00010000:00010000:3.0:1790779100.341175:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779100.341177:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662000, rc 0) 00000100:00100000:3.0:1790779100.341679:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+42:12402:x1877767642772992:12345-192.168.203.3@tcp:101:bash.0 Request processed in 5073us (5514us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1790779100.341688:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 214 00000100:00100000:1.0:1790779100.346165:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779100.346249:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642773120 00000100:00100000:3.0:1790779100.346258:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642773120 00000100:00100000:3.0:1790779100.346334:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:3.0:1790779100.346344:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2401:x1877767642773120:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779100.346377:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779100.346398:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936d9d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425aa5 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790779100.346400:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1790779100.346425:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779100.346445:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1790779100.346450:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779100.346460:0:8438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936d9d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aa5 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.346479:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936d9d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aa5 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.346492:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663a00, rc 0) 00000100:00100000:3.0:1790779100.346547:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642773120:12345-192.168.203.3@tcp:101:bash.0 Request processed in 205us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779100.346555:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:2.0:1790779100.352689:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779100.353002:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642773248 00000100:00100000:1.0:1790779100.353013:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642773248 00000100:00100000:1.0:1790779100.353085:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:1.0:1790779100.353095:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+8:12402:x1877767642773248:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1790779100.353113:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779100.353131:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425aac expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.353184:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936d9d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aa5 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.353194:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779100.353198:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779100.353203:0:8439:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.353239:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936d9d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aa5 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.353252:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936d9d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aa5 expref: 9 pid: 8438 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779100.353266:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1877767663797760:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779100.353360:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76035bd480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779100.356627:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779100.356681:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642773376 00000100:00100000:3.0:1790779100.356690:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642773376 00010000:00010000:3.0:1790779100.356725:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936d9d3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aa5 expref: 10 pid: 8438 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779100.356741:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1877767663797760:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779100.356763:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 93 00000100:00100000:3.0:1790779100.356772:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+10:2400:x1877767642773376:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779100.356774:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.356782:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779100.356794:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6800, rc 0) 00010000:00010000:3.0:1790779100.356801:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936d9d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aa5 expref: 10 pid: 8438 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.356823:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936d9d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aa5 expref: 10 pid: 8438 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.356841:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936d9d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aa5 expref: 10 pid: 8438 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.356851:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779100.356854:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779100.356859:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.356868:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779100.356919:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+9:12402:x1877767642773248:12345-192.168.203.3@tcp:101:bash.0 Request processed in 3824us (4237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779100.356928:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00010000:00010000:3.0:1790779100.357126:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779100.357142:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6508:1877767663797888:192.168.203.3@tcp:105: 00000100:00100000:3.0:1790779100.357192:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c540 going to sleep for 11 seconds 00000100:00100000:1.0:1790779100.360089:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6508:1877767663797888:192.168.203.3@tcp:105: 00010000:00010000:1.0:1790779100.360117:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779100.360225:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2400:x1877767642773376:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3454us (3605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779100.360236:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 93 00000100:00100000:2.0:1790779100.360451:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779100.360507:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642773632 00000100:00100000:3.0:1790779100.360515:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642773632 00000100:00100000:3.0:1790779100.360563:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:3.0:1790779100.360573:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+42:12402:x1877767642773632:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:3.0:1790779100.360949:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+43:12402:x1877767642773632:12345-192.168.203.3@tcp:35:bash.0 Request processed in 377us (498us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1790779100.360964:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:1.0:1790779100.518605:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779100.518742:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642773760 00000100:00100000:2.0:1790779100.518760:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642773760 00000100:00100000:2.0:1790779100.518828:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 215 00000100:00100000:2.0:1790779100.518836:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+43:12418:x1877767642773760:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779100.518859:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779100.518904:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d9e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ab3 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.518965:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d9e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.518980:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.518993:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779100.519047:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790779100.519060:0:13821:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779100.519090:0:13821:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.519113:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d9e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ab3 expref: 45 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.519135:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ab3 expref: 44 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.519143:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:2.0:1790779100.519146:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779100.519166:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b200, rc 0) 00000100:00100000:2.0:1790779100.519266:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+44:12418:x1877767642773760:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 431us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779100.519274:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 215 00000100:00100000:1.0:1790779100.525598:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779100.525732:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642774016 00000100:00100000:2.0:1790779100.525742:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642774016 00000100:00100000:2.0:1790779100.525796:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 216 00000100:00100000:2.0:1790779100.525805:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+44:12418:x1877767642774016:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779100.525826:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779100.525846:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d9ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425aba expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.526204:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d9f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.526220:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.526231:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779100.526243:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790779100.527166:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936d9ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aba expref: 47 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.527192:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aba expref: 46 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.527200:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7704171b00) 00010000:00010000:2.0:1790779100.527341:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779100.527346:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894ae00, rc 0) 00000100:00100000:2.0:1790779100.527414:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+46:12418:x1877767642774016:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1610us (1824us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1790779100.527422:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 216 00000100:00100000:1.0:1790779100.533599:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779100.533652:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779100.534070:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642774400 00000100:00100000:0.0:1790779100.534093:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642774400 00000100:00100000:0.0:1790779100.534166:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:0.0:1790779100.534175:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+46:2401:x1877767642774400:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779100.534191:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779100.534215:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936d9f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aba expref: 46 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.534234:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7704171b00) 00010000:00010000:0.0:1790779100.534239:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779100.534308:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+45:2401:x1877767642774400:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 134us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779100.534315:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1790779100.534585:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642774272 00000100:00100000:2.0:1790779100.534590:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642774272 00000100:00100000:2.0:1790779100.534632:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 217 00000100:00100000:2.0:1790779100.534641:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+45:12418:x1877767642774272:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779100.534661:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779100.534675:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ac1 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.534773:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936da0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.534787:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936da0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.534797:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936da0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779100.534809:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790779100.534936:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ac1 expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.534951:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936da0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ac1 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.534973:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7704171b00) 00010000:00010000:2.0:1790779100.534976:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790779100.534979:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b800, rc 0) 00000100:00100000:2.0:1790779100.535012:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+47:12418:x1877767642774272:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 372us (1422us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1790779100.535018:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 217 00000100:00100000:1.0:1790779100.551412:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779100.551557:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642774528 00000100:00100000:3.0:1790779100.551567:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642774528 00000100:00100000:3.0:1790779100.551624:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:3.0:1790779100.551635:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2399:x1877767642774528:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:3.0:1790779100.551679:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.551699:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.551718:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779100.551723:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790779100.551727:0:8438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.551759:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.551773:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 8 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779100.551788:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1877767663798016:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779100.551917:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779100.557318:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779100.557473:0:8444:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642774656 00000100:00100000:0.0:1790779100.557483:0:8444:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642774656 00002000:00100000:0.0:1790779100.557534:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9b7603a5bb80 x1877767642774656/t0(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:651/0 lens 504/0 e 0 to 0 dl 1790779111 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790779100.557546:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603a5bb80 with x1877767642774656 ext(0->8) 00010000:00010000:0.0:1790779100.557557:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 9 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.557573:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 9 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779100.557581:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b7603a5bb80 00000100:00100000:0.0:1790779100.557614:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1790779100.557624:0:8444:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2400:x1877767642774656:12345-192.168.203.3@tcp:4:lfs.0 00000100:00100000:3.0:1790779100.559241:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1877767663798016:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779100.559284:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779100.559584:0:8444:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+11:2400:x1877767642774656:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 1960us (2273us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790779100.559594:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00002000:00100000:0.0:1790779100.559605:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9b7603a5bb80 x1877767642774656/t4294967309(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:651/0 lens 504/448 e 0 to 0 dl 1790779111 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790779100.559615:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603a5bb80 with x1877767642774656 ext(0->8) 00010000:00010000:0.0:1790779100.559622:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 11 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.559635:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 11 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779100.559644:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b7603a5bb80 00000100:00100000:1.0:1790779100.564475:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779100.564658:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642774784 00000100:00100000:0.0:1790779100.564668:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642774784 00010000:00010000:0.0:1790779100.564771:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 11 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779100.564814:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 94 00000100:00100000:0.0:1790779100.564825:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+11:2400:x1877767642774784:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779100.564841:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790779100.564859:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790779100.564862:0:6509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790779100 00002000:00010000:0.0:1790779100.564865:0:6509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790779100 00002000:00010000:0.0:1790779100.564867:0:6509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1790779100 00002000:00010000:0.0:1790779100.564911:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1790779100.564919:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 11 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.564934:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 11 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.564958:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073a0219a/0xb1aa4014e936d9da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aac expref: 11 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.564989:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790779100.564993:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790779100.564999:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.565011:0:6509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.565187:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779100.565252:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+10:2400:x1877767642774784:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 428us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779100.565259:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 94 00010000:00010000:3.0:1790779100.565663:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.565674:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.565695:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.565703:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.565780:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.565788:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779100.565792:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.565802:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.565816:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.565832:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f0616d/0xb1aa4014e936da19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779100.565931:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2399:x1877767642774528:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 14298us (14528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779100.565940:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:1.0:1790779100.570195:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779100.570321:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642775040 00000100:00100000:0.0:1790779100.570331:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642775040 00000100:00100000:0.0:1790779100.570385:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:0.0:1790779100.570395:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718264450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+47:12418:x1877767642775040:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:0.0:1790779100.570464:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936da0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ac1 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790779100.570656:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1790779100.570689:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1790779100.571058:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1790779100.571112:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.571128:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a9e expref: 51 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.571138:0:6526:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.571173:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a9e expref: 51 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.571186:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a9e expref: 51 pid: 13003 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779100.571200:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1877767663798144:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779100.571292:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c780 going to sleep for 11 seconds 00000100:00100000:1.0:1790779100.575369:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779100.575489:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1877767663798144:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779100.575514:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779100.576015:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642775168 00000100:00100000:2.0:1790779100.576022:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642775168 00010000:00010000:2.0:1790779100.576067:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a9e expref: 52 pid: 13003 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779100.576113:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:2.0:1790779100.576123:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+52:2400:x1877767642775168:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779100.576137:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779100.576144:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a9e expref: 52 pid: 13003 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.576155:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a9e expref: 52 pid: 13003 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.576176:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936d9c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a9e expref: 52 pid: 13003 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.576193:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7704171b00) 00010000:00010000:2.0:1790779100.576198:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.576221:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.576228:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.576269:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779100.576327:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+51:2400:x1877767642775168:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 205us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779100.576336:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 95 00010000:00010000:0.0:1790779100.576649:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.576658:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790779100.576779:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1790779100.576944:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1790779100.577029:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663798272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790779100.577087:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779100.577124:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779100.577289:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663798272 00000100:00100000:1.0:1790779100.577294:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663798272 00000100:00100000:1.0:1790779100.577339:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790779100.577348:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1877767663798272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790779100.577423:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1877767663798272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779100.577431:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1790779100.577847:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663798272:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790779100.577995:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1790779100.578070:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663798400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790779100.578113:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779100.578130:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790779100.578238:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663798400 00000100:00100000:1.0:1790779100.578243:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663798400 00000100:00100000:1.0:1790779100.578288:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1790779100.578297:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1877767663798400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790779100.578404:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6526:x1877767663798400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (290us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790779100.578426:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790779100.578700:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1877767663798400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790779100.578753:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1790779100.578789:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.578800:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.578807:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.578813:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779100.578818:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.578826:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.578840:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7704171b00) 00010000:00010000:2.0:1790779100.578843:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790779100.578855:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.578861:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936da20 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790779100.578980:0:6526:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790779100.579063:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1790779100.579076:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418586195374ns, next at 419586192897ns, rc = 0 00000001:00080000:2.0:1790779100.579082:0:6526:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1790779100.579406:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7704171b00) 00010000:00010000:2.0:1790779100.579410:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790779100.579417:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936da0b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ac1 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779100.579522:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718264450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+54:12418:x1877767642775040:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 9128us (9335us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1790779100.579531:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000020:00080000:2.0:1790779100.579535:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790779100.583991:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779100.584652:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642775296 00000100:00100000:0.0:1790779100.584663:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642775296 00000100:00100000:0.0:1790779100.584830:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 218 00000100:00100000:0.0:1790779100.584841:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+54:12418:x1877767642775296:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1790779100.584865:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779100.584918:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936da27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ac8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.584986:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936da27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ac8 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.585001:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936da27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ac8 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.585031:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:0.0:1790779100.585056:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790779100.585060:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768a00, rc 0) 00000100:00100000:0.0:1790779100.585241:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+55:12418:x1877767642775296:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 402us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779100.585248:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 218 00000100:00100000:1.0:1790779100.589535:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779100.590250:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642775552 00000100:00100000:2.0:1790779100.590272:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642775552 00000100:00100000:2.0:1790779100.590333:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:2.0:1790779100.590344:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+55:12418:x1877767642775552:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779100.590586:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+56:12418:x1877767642775552:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 242us (1058us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1790779100.590594:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1790779100.713622:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779100.713809:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642775680 00000100:00100000:2.0:1790779100.713819:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642775680 00000100:00100000:0.0:1790779100.713927:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 219 00000100:00100000:0.0:1790779100.713942:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76035c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+56:12428:x1877767642775680:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:0.0:1790779100.714021:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da2e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714038:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714061:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714075:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714083:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714090:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714171:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714180:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714205:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790779100.714254:0:10428:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714266:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714273:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da2e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714280:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da2e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714286:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779100.714290:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da2e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714299:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da2e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714311:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:0.0:1790779100.714314:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779100.714319:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714325:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714338:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714351:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714357:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714362:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779100.714366:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714373:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714380:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b76026e7000) 00010000:00010000:0.0:1790779100.714383:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779100.714386:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714392:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714403:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714408:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714414:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714419:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779100.714429:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714435:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714443:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:0.0:1790779100.714445:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779100.714448:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.714454:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779100.714698:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76035c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+56:12428:x1877767642775680:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 757us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779100.714707:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 219 00000100:00100000:3.0:1790779100.776274:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663798528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779100.776434:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779100.777398:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663798528 00000100:00100000:0.0:1790779100.777408:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663798528 00000100:00100000:0.0:1790779100.777468:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790779100.777478:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663798528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779100.777521:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790779100.781417:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663798528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3930us (4973us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779100.781432:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790779100.782439:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663798528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779100.800436:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779100.800662:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642775936 00000100:00100000:2.0:1790779100.800672:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642775936 00000100:00100000:2.0:1790779100.800736:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 220 00000100:00100000:2.0:1790779100.800746:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+56:12431:x1877767642775936:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779100.800765:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779100.800786:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936da43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425acf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.800855:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936da4a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.800868:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936da4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.800897:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936da4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.800911:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.800919:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.800926:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801097:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936da58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801106:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936da58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801131:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936da58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779100.801141:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790779100.801215:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936da4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801223:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936da4a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801230:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936da4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801236:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ae00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779100.801240:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936da4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801248:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936da4a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801258:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:2.0:1790779100.801261:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779100.801265:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936da4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801271:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936da4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801285:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801291:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801304:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801309:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779100.801313:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801319:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801328:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b76026e7000) 00010000:00010000:2.0:1790779100.801330:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779100.801334:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801339:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936da51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801374:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936da43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425acf expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801388:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936da58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425acf expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.801394:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:2.0:1790779100.801396:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779100.801398:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3e00, rc 0) 00000100:00100000:2.0:1790779100.801669:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+58:12431:x1877767642775936:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 785us (1101us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1790779100.801692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 220 00000100:00100000:1.0:1790779100.815662:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779100.815820:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642776064 00000100:00100000:2.0:1790779100.815830:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642776064 00000100:00100000:2.0:1790779100.816119:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:2.0:1790779100.816131:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+58:12431:x1877767642776064:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:2.0:1790779100.816203:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936da66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.816221:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936da66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.816232:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936da66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.816266:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936da66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.816273:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936da66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.816287:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936da66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.816293:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779100.816297:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936da66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.816304:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936da66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.816315:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:2.0:1790779100.816332:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779100.816338:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936da66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.816345:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936da66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779100.816432:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+58:12431:x1877767642776064:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 303us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779100.816440:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:1.0:1790779100.824720:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779100.824812:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642776320 00000100:00100000:2.0:1790779100.824823:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642776320 00000100:00100000:2.0:1790779100.824910:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:2.0:1790779100.824920:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+58:12431:x1877767642776320:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779100.825154:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+59:12431:x1877767642776320:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 235us (444us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1790779100.825162:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:1.0:1790779100.900453:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779100.901013:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642776576 00000100:00100000:3.0:1790779100.901025:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642776576 00000100:00100000:3.0:1790779100.901163:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:3.0:1790779100.901174:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+59:12442:x1877767642776576:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1790779100.901200:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779100.901202:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790779100.901227:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936d9e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ab3 expref: 59 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.901255:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779100.901260:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779100.901273:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936da6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ad6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.901409:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.901423:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936da58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425acf expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.901437:0:6524:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.901465:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936da58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425acf expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.901477:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936da58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425acf expref: 59 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779100.901489:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1877767663798656:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779100.901585:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779100.906671:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779100.906771:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1877767663798656:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779100.906802:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779100.906907:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642776704 00000100:00100000:0.0:1790779100.906914:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642776704 00010000:00010000:0.0:1790779100.906948:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936da58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425acf expref: 60 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779100.907002:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:0.0:1790779100.907011:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+60:2400:x1877767642776704:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779100.907028:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779100.907035:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936da58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425acf expref: 60 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.907056:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936da58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425acf expref: 60 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.907078:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3e00/0xb1aa4014e936da58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425acf expref: 60 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.907093:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:0.0:1790779100.907099:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.907108:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.907115:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.907136:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779100.907424:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.907432:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779100.907450:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790779100.907566:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936da6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ad6 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.907582:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ad6 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779100.907601:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:3.0:1790779100.907603:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790779100.907606:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663000, rc 0) 00000100:00100000:3.0:1790779100.907654:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+60:12442:x1877767642776576:12345-192.168.203.3@tcp:101:bash.0 Request processed in 6482us (7210us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1790779100.907661:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:0.0:1790779100.908505:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+59:2400:x1877767642776704:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1490us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779100.908514:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:1.0:1790779100.912742:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779100.912947:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642776832 00000100:00100000:0.0:1790779100.912977:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642776832 00000100:00100000:0.0:1790779100.913095:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 223 00000100:00100000:0.0:1790779100.913105:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+59:12442:x1877767642776832:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1790779100.913127:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779100.913155:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da82 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425add expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.913185:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.913199:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.913209:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.913434:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425add expref: 61 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.913450:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425add expref: 60 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.913459:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:0.0:1790779100.913462:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790779100.913466:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768000, rc 0) 00000100:00100000:0.0:1790779100.913519:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+60:12442:x1877767642776832:12345-192.168.203.3@tcp:101:bash.0 Request processed in 416us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779100.913526:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 223 00000100:00100000:1.0:1790779100.925072:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779100.925113:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642777088 00000100:00100000:0.0:1790779100.925135:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642777088 00000100:00100000:0.0:1790779100.925191:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 224 00000100:00100000:0.0:1790779100.925201:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+60:12442:x1877767642777088:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:1.0:1790779100.926266:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.926441:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.926454:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779100.926494:0:6525:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1790779100.926513:0:6525:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c9070abb reply state 000000008840b654 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.926524:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779100.926532:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:1.0:1790779100.926534:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779100.926547:0:6525:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779100.926673:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12442:x1877767642777088:12345-192.168.203.3@tcp:36:bash.0 Request processed in 1471us (1608us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1790779100.926681:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 224 00000020:00080000:1.0:1790779100.926686:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790779100.938481:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779100.938781:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642777216 00000100:00100000:0.0:1790779100.938791:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642777216 00000100:00100000:0.0:1790779100.938859:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 225 00000100:00100000:0.0:1790779100.938869:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12442:x1877767642777216:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1790779100.938920:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779100.938942:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ae4 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.939029:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.939043:0:10428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ad6 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.939064:0:10428:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.939096:0:10428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ad6 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.939110:0:10428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ad6 expref: 64 pid: 6524 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779100.939123:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663798784:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779100.939191:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779100.944379:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663798784:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779100.944406:0:10428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779100.951128:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779100.951399:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642777344 00000100:00100000:2.0:1790779100.951409:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642777344 00010000:00010000:2.0:1790779100.951456:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ad6 expref: 65 pid: 6524 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779100.951499:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:2.0:1790779100.951509:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+65:2401:x1877767642777344:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779100.951523:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779100.951530:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ad6 expref: 65 pid: 6524 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.951562:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ad6 expref: 65 pid: 6524 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.951583:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663000/0xb1aa4014e936da74 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ad6 expref: 65 pid: 6524 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.951598:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:2.0:1790779100.951604:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.951614:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.951622:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779100.951707:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779100.951762:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+64:2401:x1877767642777344:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 254us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779100.951771:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 97 00010000:00010000:0.0:1790779100.954824:0:10428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.954913:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779100.954979:0:10428:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790779100.954983:0:10428:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779100.955006:0:10428:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.955057:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936da97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ae4 expref: 64 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.955083:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ae4 expref: 63 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779100.955092:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:0.0:1790779100.955094:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790779100.955098:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769e00, rc 0) 00000100:00100000:0.0:1790779100.955163:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12442:x1877767642777216:12345-192.168.203.3@tcp:101:bash.0 Request processed in 16294us (16689us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779100.955171:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 225 00000100:00100000:1.0:1790779100.963449:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779100.966116:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642777600 00000100:00100000:2.0:1790779100.966130:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642777600 00000100:00100000:2.0:1790779100.966256:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:2.0:1790779100.966268:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+63:12442:x1877767642777600:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:2.0:1790779100.966548:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+64:12442:x1877767642777600:12345-192.168.203.3@tcp:35:bash.0 Request processed in 282us (3106us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1790779100.966556:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:2.0:1790779101.066848:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.069030:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642777728 00000100:00100000:1.0:1790779101.069054:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642777728 00000100:00100000:1.0:1790779101.069145:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 226 00000100:00100000:1.0:1790779101.069157:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+64:12448:x1877767642777728:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779101.069183:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779101.069203:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936daa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425aeb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.069269:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936daac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.069285:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936daac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.069299:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936daac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779101.069340:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790779101.069343:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779101.069361:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936daac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.069384:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936daa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aeb expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.069417:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936daac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aeb expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.069426:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:1.0:1790779101.069429:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790779101.069432:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7c00, rc 0) 00000100:00100000:1.0:1790779101.069499:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12448:x1877767642777728:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 346us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.069505:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 226 00000100:00080000:2.0:1790779101.070083:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779101.077714:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779101.077831:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642777856 00000100:00100000:2.0:1790779101.077840:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642777856 00000100:00100000:2.0:1790779101.077915:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 227 00000100:00100000:2.0:1790779101.077924:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12448:x1877767642777856:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779101.077946:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779101.077977:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936dab3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425af2 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078057:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936daba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078072:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936daba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078084:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936daba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078096:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936dac1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078103:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936dac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078109:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936dac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078199:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936dac8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078493:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936dac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078517:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936dac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779101.078559:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790779101.078564:0:13821:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779101.078584:0:13821:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936dac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078597:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936dac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078606:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936daba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078613:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936daba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078621:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936daba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078628:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779101.078633:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936daba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078641:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936daba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078653:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:2.0:1790779101.078656:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779101.078660:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936daba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078677:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936daba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078691:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936dac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078697:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936dac1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078703:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936dac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078708:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779101.078711:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936dac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078716:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936dac1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078724:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b76026e7000) 00010000:00010000:2.0:1790779101.078726:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779101.078729:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936dac1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078734:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3800/0xb1aa4014e936dac1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078761:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3c00/0xb1aa4014e936dab3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af2 expref: 67 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078785:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936dac8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af2 expref: 66 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.078791:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:2.0:1790779101.078794:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779101.078796:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2000, rc 0) 00000100:00100000:2.0:1790779101.078869:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+66:12448:x1877767642777856:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 946us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779101.078877:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 227 00000100:00100000:3.0:1790779101.082730:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.082824:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642777984 00000100:00100000:1.0:1790779101.082834:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642777984 00000100:00100000:1.0:1790779101.082923:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1790779101.082933:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+66:2400:x1877767642777984:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779101.082949:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779101.082983:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936dac8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af2 expref: 66 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.083002:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:1.0:1790779101.083007:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779101.083511:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+65:2400:x1877767642777984:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 579us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.083520:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1790779101.084968:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779101.085129:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642778240 00000100:00100000:3.0:1790779101.085138:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642778240 00000100:00100000:3.0:1790779101.085201:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 228 00000100:00100000:3.0:1790779101.085373:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ea49c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12448:x1877767642778240:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779101.085395:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779101.085416:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936dacf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425af9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.085517:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.085531:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ae4 expref: 66 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.085540:0:6524:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.085575:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ae4 expref: 66 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.085608:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ae4 expref: 66 pid: 10428 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779101.085623:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1877767663798912:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779101.085716:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779101.103616:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779101.104174:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1877767663798912:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779101.104215:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.105583:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642778368 00000100:00100000:0.0:1790779101.105596:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642778368 00010000:00010000:0.0:1790779101.105643:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ae4 expref: 67 pid: 10428 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.105706:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00100000:0.0:1790779101.105717:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+67:2401:x1877767642778368:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779101.105733:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779101.105741:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ae4 expref: 67 pid: 10428 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.105755:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ae4 expref: 67 pid: 10428 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.105780:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936da9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ae4 expref: 67 pid: 10428 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.105796:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:0.0:1790779101.105801:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.105812:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.105820:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.105858:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779101.105966:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+66:2401:x1877767642778368:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 251us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779101.105974:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 98 00010000:00010000:1.0:1790779101.106802:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.106824:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779101.106842:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790779101.106993:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936dacf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af9 expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.107011:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af9 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.107029:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:1.0:1790779101.107032:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790779101.107035:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662a00, rc 0) 00000100:00100000:1.0:1790779101.107094:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ea49c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+66:12448:x1877767642778240:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 21724us (22141us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1790779101.107102:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 228 00000100:00100000:2.0:1790779101.114229:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.114410:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642778624 00000100:00100000:0.0:1790779101.114436:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642778624 00000100:00100000:0.0:1790779101.114497:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:0.0:1790779101.114506:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+66:12448:x1877767642778624:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:0.0:1790779101.114522:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779101.114546:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936da27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ac8 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.114564:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:0.0:1790779101.114569:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779101.114629:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12448:x1877767642778624:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 125us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779101.114636:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:2.0:1790779101.125688:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.125846:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642778752 00000100:00100000:1.0:1790779101.125856:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642778752 00000100:00100000:1.0:1790779101.125919:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 229 00000100:00100000:1.0:1790779101.125929:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12448:x1877767642778752:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:1.0:1790779101.126029:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.126055:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.126067:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779101.126190:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1790779101.126285:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12448:x1877767642778752:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 357us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.126293:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 229 00000100:00100000:2.0:1790779101.129569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.129909:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642778880 00000100:00100000:1.0:1790779101.129918:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642778880 00000100:00100000:1.0:1790779101.129974:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 230 00000100:00100000:1.0:1790779101.129983:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+65:12448:x1877767642778880:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779101.130003:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779101.130174:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936daeb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b00 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.130236:0:13821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.130246:0:13821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936daeb lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b00 expref: 66 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.130264:0:13821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.130277:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936daeb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b00 expref: 66 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.130289:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:1.0:1790779101.130292:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779101.130296:0:13821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936daeb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b00 expref: 66 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.130317:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6000, rc 0) 00000100:00100000:1.0:1790779101.130377:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+66:12448:x1877767642778880:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 395us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.130385:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 230 00010000:00010000:1.0:1790779101.160610:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790779101.224109:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790779101.224119:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790779101.224144:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:3.0:1790779101.224154:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790779101.224313:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663799040:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790779101.224432:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c000 going to sleep for 11 seconds 00000100:00100000:3.0:1790779101.228936:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663799040:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790779101.233734:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.233849:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642779008 00000100:00100000:0.0:1790779101.233859:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642779008 00000100:00100000:0.0:1790779101.233943:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 231 00000100:00100000:0.0:1790779101.233953:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+66:12449:x1877767642779008:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790779101.233983:0:10428:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790779101.234115:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+66:12449:x1877767642779008:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 163us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779101.234123:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 231 00000100:00100000:2.0:1790779101.247475:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.247574:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642779136 00000100:00100000:1.0:1790779101.247584:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642779136 00000100:00100000:1.0:1790779101.247648:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00100000:1.0:1790779101.247657:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+66:12449:x1877767642779136:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790779101.247731:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936daf2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.247750:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936daf2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.247762:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936daf2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.247831:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936daf9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.247839:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936daf9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.247846:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936daf9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.247867:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.247937:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.247946:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779101.247992:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790779101.247996:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779101.248009:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248020:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936daf2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248027:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936daf2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248035:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936daf2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248041:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779101.248054:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936daf2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248062:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936daf2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248075:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:1.0:1790779101.248078:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779101.248084:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936daf2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248100:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936daf2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248113:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936daf9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248118:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936daf9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248124:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936daf9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248128:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779101.248131:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936daf9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248136:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936daf9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248144:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9b76026e7900) 00010000:00010000:1.0:1790779101.248146:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779101.248149:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936daf9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248155:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936daf9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248170:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248176:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248189:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248193:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779101.248197:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248366:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248376:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:1.0:1790779101.248378:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779101.248381:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.248387:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779101.248479:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+66:12449:x1877767642779136:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 822us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.248488:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00100000:2.0:1790779101.251928:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.252007:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642779392 00000100:00100000:1.0:1790779101.252018:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642779392 00000100:00100000:1.0:1790779101.252090:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 233 00000100:00100000:1.0:1790779101.252101:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+66:12449:x1877767642779392:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779101.252123:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779101.252141:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db07 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b07 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252275:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252290:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252302:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779101.252312:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790779101.252386:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252394:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252401:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252407:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779101.252411:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252418:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252429:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:1.0:1790779101.252433:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790779101.252437:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252454:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252494:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db07 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b07 expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252504:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:1.0:1790779101.252506:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790779101.252510:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db07 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b07 expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.252520:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6e00, rc 0) 00000100:00100000:1.0:1790779101.252582:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+67:12449:x1877767642779392:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 483us (662us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1790779101.252588:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 233 00000100:00100000:2.0:1790779101.255353:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.255445:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642779520 00000100:00100000:0.0:1790779101.255454:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642779520 00000100:00100000:0.0:1790779101.255514:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 234 00000100:00100000:0.0:1790779101.255524:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+67:12449:x1877767642779520:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790779101.255555:0:10428:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790779101.255662:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+67:12449:x1877767642779520:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 139us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779101.255682:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 234 00000100:00100000:2.0:1790779101.260323:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.260685:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642779776 00000100:00100000:1.0:1790779101.260695:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642779776 00000100:00100000:1.0:1790779101.260752:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 235 00000100:00100000:1.0:1790779101.260762:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+67:12449:x1877767642779776:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779101.260784:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779101.260788:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790779101.260814:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936daac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425aeb expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.260832:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:1.0:1790779101.260838:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779101.260866:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db1c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b0e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790779101.261281:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1790779101.261401:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936db23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.261414:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936db23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.261425:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936db23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.261469:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db1c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b0e expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.261483:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936db23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b0e expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.261490:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b76026e7900) 00010000:00010000:1.0:1790779101.261492:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779101.261495:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7400, rc 0) 00000100:00100000:1.0:1790779101.261560:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+68:12449:x1877767642779776:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 799us (1248us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1790779101.261567:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 235 00000100:00100000:2.0:1790779101.267914:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.268121:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642780032 00000100:00100000:1.0:1790779101.268131:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642780032 00000100:00100000:1.0:1790779101.268198:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 236 00000100:00100000:1.0:1790779101.268208:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+68:12449:x1877767642780032:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790779101.268284:0:13821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779101.268310:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936db23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b0e expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268328:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b76026e7900) 00010000:00010000:1.0:1790779101.268340:0:13821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779101.268360:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268373:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268383:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268448:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xfc84539e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268456:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfc84539e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268462:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfc84539e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268505:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268513:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db31 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268520:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268532:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779101.268537:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268545:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268553:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:1.0:1790779101.268556:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779101.268560:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db31 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268566:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268576:0:13821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfc84539e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268582:0:13821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db38 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfc84539e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268587:0:13821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db38 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfc84539e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268592:0:13821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779101.268595:0:13821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db38 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfc84539e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268601:0:13821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db38 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfc84539e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268616:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xfc84539e (ffff9b76026e7700) 00010000:00010000:1.0:1790779101.268619:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779101.268622:0:13821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db38 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfc84539e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.268628:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936db38 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfc84539e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779101.268705:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+67:12449:x1877767642780032:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 498us (830us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790779101.268713:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 236 00000100:00100000:2.0:1790779101.279239:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.279326:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642780160 00000100:00100000:0.0:1790779101.279337:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642780160 00000100:00100000:0.0:1790779101.279403:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 237 00000100:00100000:0.0:1790779101.279415:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+67:12449:x1877767642780160:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779101.279436:0:10428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779101.279460:0:10428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936db3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b15 expref: -99 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.279495:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.279511:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.279523:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.279651:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936db3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b15 expref: 69 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.279671:0:10428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b15 expref: 68 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.279679:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:0.0:1790779101.279682:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790779101.279686:0:10428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769e00, rc 0) 00000100:00100000:0.0:1790779101.279755:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+68:12449:x1877767642780160:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 344us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779101.279769:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 237 00000100:00100000:2.0:1790779101.286013:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.286108:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642780416 00000100:00100000:1.0:1790779101.286118:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642780416 00000100:00100000:1.0:1790779101.286176:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 238 00000100:00100000:1.0:1790779101.286186:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+68:12449:x1877767642780416:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790779101.286271:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.286290:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.286302:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779101.286463:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1790779101.286474:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 419293593608ns, next at 420293591328ns, rc = 0 00000004:00010000:1.0:1790779101.286527:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002fc773f7 reply state 00000000172da4e4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.286560:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.286568:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:1.0:1790779101.286572:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790779101.286576:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779101.286731:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+70:12449:x1877767642780416:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 546us (728us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1790779101.286740:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 238 00000100:00100000:1.0:1790779101.294306:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779101.294538:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642780544 00000100:00100000:3.0:1790779101.294549:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642780544 00000100:00100000:3.0:1790779101.294611:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 239 00000100:00100000:3.0:1790779101.294622:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+70:12449:x1877767642780544:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779101.294648:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779101.294671:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936db54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b1c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.294734:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936db54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b1c expref: 71 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.294766:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936db54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b1c expref: 71 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.294786:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:3.0:1790779101.294790:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790779101.294794:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662800, rc 0) 00000100:00100000:3.0:1790779101.294858:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+71:12449:x1877767642780544:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 238us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779101.294865:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 239 00000100:00100000:2.0:1790779101.301321:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.301458:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642780672 00000100:00100000:1.0:1790779101.301468:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642780672 00000100:00100000:1.0:1790779101.301540:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:1.0:1790779101.301550:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2399:x1877767642780672:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790779101.301775:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+10:2399:x1877767642780672:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 226us (462us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1790779101.301783:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00080000:2.0:1790779101.301846:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779101.308110:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.308244:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642780928 00000100:00100000:1.0:1790779101.308255:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642780928 00000100:00100000:1.0:1790779101.308314:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:1.0:1790779101.308324:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+71:12449:x1877767642780928:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790779101.308546:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+72:12449:x1877767642780928:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 224us (448us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1790779101.308553:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:0.0:1790779101.314741:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.318455:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642781184 00000100:00100000:1.0:1790779101.318485:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642781184 00000100:00100000:1.0:1790779101.318542:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 240 00000100:00100000:1.0:1790779101.318551:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+72:12449:x1877767642781184:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790779101.318725:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+72:12449:x1877767642781184:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 174us (3995us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.318733:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 240 00000100:00100000:2.0:1790779101.326701:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.328247:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642781312 00000100:00100000:0.0:1790779101.328259:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642781312 00000100:00100000:0.0:1790779101.328377:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:0.0:1790779101.328386:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+72:12449:x1877767642781312:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779101.328408:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779101.328429:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936db5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b23 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.328500:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936db62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.328515:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936db62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.328526:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936db62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779101.328567:0:13003:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779101.328584:0:13003:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936db62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.328610:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936db5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b23 expref: 74 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.328626:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936db62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b23 expref: 73 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.328653:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:0.0:1790779101.328656:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790779101.328660:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769400, rc 0) 00000100:00100000:0.0:1790779101.328730:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+73:12449:x1877767642781312:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 345us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779101.328738:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:2.0:1790779101.335489:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779101.335660:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642781440 00000100:00100000:3.0:1790779101.335669:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642781440 00000100:00100000:3.0:1790779101.335775:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:3.0:1790779101.335786:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+10:2400:x1877767642781440:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779101.335819:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779101.335840:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936db69 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b2a expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779101.335864:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd1edc, blocks: 0x0 00010000:00010000:3.0:1790779101.335935:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790779101.335940:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779101.335951:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936db69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b2a expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.336005:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936db69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b2a expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.336077:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663a00, rc 0) 00000100:00100000:3.0:1790779101.336163:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+11:2400:x1877767642781440:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 379us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779101.336183:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:2.0:1790779101.340112:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.340262:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642781696 00000100:00100000:1.0:1790779101.340272:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642781696 00000100:00100000:1.0:1790779101.340332:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:1.0:1790779101.340341:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+73:12449:x1877767642781696:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790779101.340438:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+73:12449:x1877767642781696:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 97us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.340445:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:2.0:1790779101.350848:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.350949:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642781824 00000100:00100000:1.0:1790779101.350968:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642781824 00000100:00100000:1.0:1790779101.351033:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:1.0:1790779101.351049:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+11:12449:x1877767642781824:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779101.351068:0:8855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779101.351085:0:8855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b31 expref: -99 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.351116:0:8855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936db69 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b2a expref: 12 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.351126:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779101.351130:0:8855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779101.351148:0:8855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 12 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.351183:0:8855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936db69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b2a expref: 12 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.351197:0:8855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936db69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b2a expref: 12 pid: 8440 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779101.351211:0:8855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8855:1877767663799168:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779101.351304:0:8855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76035bd480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779101.359916:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.360170:0:8855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8855:1877767663799168:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779101.360205:0:8855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 12 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.360225:0:8855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7e00, rc 0) 00000100:00100000:1.0:1790779101.360283:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+12:12449:x1877767642781824:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 9242us (9445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.360292:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:0.0:1790779101.360649:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642781952 00000100:00100000:0.0:1790779101.360657:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642781952 00010000:00010000:0.0:1790779101.360689:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936db69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b2a expref: 12 pid: 8440 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.360724:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:0.0:1790779101.360732:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+12:2401:x1877767642781952:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779101.360746:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779101.360768:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936db69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b2a expref: 12 pid: 8440 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.360781:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936db69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b2a expref: 12 pid: 8440 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.360805:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936db69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b2a expref: 12 pid: 8440 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.360820:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779101.360839:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779101.360848:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 11 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.360859:0:6510:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 11 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.360941:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 11 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.360956:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6510:1877767663799296:192.168.203.3@tcp:105: 00000100:00100000:0.0:1790779101.361030:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c780 going to sleep for 11 seconds 00000100:00100000:0.0:1790779101.368624:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6510:1877767663799296:192.168.203.3@tcp:105: 00010000:00010000:0.0:1790779101.368649:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779101.368700:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+11:2401:x1877767642781952:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 7968us (8822us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779101.368711:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:0.0:1790779101.375295:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779101.375604:0:8443:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642782080 00000100:00100000:3.0:1790779101.375614:0:8443:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642782080 00002000:00100000:3.0:1790779101.375666:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9b7603bd1500 x1877767642782080/t0(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:652/0 lens 504/0 e 0 to 0 dl 1790779112 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790779101.375678:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603bd1500 with x1877767642782080 ext(0->12) 00002000:00010000:3.0:1790779101.375684:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603bd1500 00000100:00100000:3.0:1790779101.375715:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1790779101.375725:0:8443:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+11:2400:x1877767642782080:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790779101.378330:0:8443:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+13:2400:x1877767642782080:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 2596us (3038us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1790779101.378342:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00002000:00100000:3.0:1790779101.378356:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9b7603bd1500 x1877767642782080/t4294967321(0) o4->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:652/0 lens 504/448 e 0 to 0 dl 1790779112 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790779101.378367:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603bd1500 with x1877767642782080 ext(0->12) 00002000:00010000:3.0:1790779101.378373:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603bd1500 00000100:00100000:2.0:1790779101.393493:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.393574:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642782208 00000100:00100000:1.0:1790779101.393584:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642782208 00000100:00100000:1.0:1790779101.393637:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:1.0:1790779101.393645:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+73:12449:x1877767642782208:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790779101.398322:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1790779101.398338:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1790779101.398396:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1790779101.398427:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b771854ccc0 refcount 2 committed 0 result 0 batchid 7 00000100:00100000:1.0:1790779101.398680:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663799552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790779101.398746:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779101.398818:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663799552 00000100:00100000:1.0:1790779101.398826:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663799552 00000100:00100000:1.0:1790779101.398865:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790779101.398874:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663799552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790779101.399037:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790779101.399051:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1790779101 00002000:00010000:1.0:1790779101.399054:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790779101.399056:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790779100 -> 1790779101 00002000:00010000:1.0:1790779101.399065:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1790779101.399108:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1877767663799552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 235us (360us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1790779101.399115:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:1.0:1790779101.399156:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603843480/2, rc 0, transno 4294967322 00000100:00100000:1.0:1790779101.399162:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663799552:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1790779101.399485:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b7707eccc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b771854c3c0 00000020:00080000:3.0:1790779101.399491:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b7707ecc500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7735fbb600 00000004:00080000:3.0:1790779101.399674:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1790779101.399708:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b760376c900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1790779101.399711:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b773b6bbe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b760376cf00 00000020:00080000:3.0:1790779101.399714:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b773b6bbd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b760378f000 00000020:00080000:3.0:1790779101.399726:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1790779101.399853:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1790779101.399938:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1790779101.400140:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+27:12449:x1877767642782208:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 6491us (6651us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.400149:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 243 00010000:00010000:2.0:1790779101.400751:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400764:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400772:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400777:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779101.400782:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400789:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400804:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b7603616500) 00010000:00010000:2.0:1790779101.400807:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779101.400812:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400819:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936d875 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400847:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400853:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400871:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400876:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ba00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779101.400925:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400932:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400940:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b76026e7e00) 00010000:00010000:2.0:1790779101.400943:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779101.400946:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400962:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936d91d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400978:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400984:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400989:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.400993:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779101.400996:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401019:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401028:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b76026e7000) 00010000:00010000:2.0:1790779101.401030:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779101.401032:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401037:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7200/0xb1aa4014e936d99b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401066:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401074:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401078:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401083:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779101.401085:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401091:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401098:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b76026e7000) 00010000:00010000:2.0:1790779101.401100:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779101.401102:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401113:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663400/0xb1aa4014e936d9be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401131:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401138:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401143:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401149:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779101.401152:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401158:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401168:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:2.0:1790779101.401171:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779101.401174:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401180:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936da90 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401192:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401198:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401209:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401216:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779101.401220:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401227:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401236:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00000100:00100000:0.0:1790779101.401237:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1790779101.401240:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790779101.401244:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.401249:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936db4d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.401257:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663799680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790779101.401274:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663799424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790779101.401773:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779101.401837:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663799424 00000100:00100000:2.0:1790779101.401845:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663799424 00000100:00100000:2.0:1790779101.401911:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790779101.401919:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1877767663799424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790779101.401959:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1790779101.401981:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.402000:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936d92b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a89 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.402028:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1790779101.402032:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790779101.402036:0:8438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.402405:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936d92b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a89 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.402420:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936d92b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a89 expref: 12 pid: 8440 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779101.402434:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1877767663799808:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779101.402495:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7712564c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779101.404146:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.404767:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642782336 00000100:00100000:1.0:1790779101.404777:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642782336 00000100:00100000:1.0:1790779101.404840:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:1.0:1790779101.404850:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+13:2399:x1877767642782336:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790779101.405096:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779101.405381:0:8855:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1790779101.405400:0:8855:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1790779101.407192:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663799680 00000100:00100000:3.0:1790779101.407207:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663799680 00000001:00080000:1.0:1790779101.409305:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1790779101.409321:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:3.0:1790779101.409645:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2399:x1877767642782336:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 4789us (5500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779101.409657:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:3.0:1790779101.409687:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790779101.409699:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3649:x1877767663799680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790779101.409739:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1790779101.409771:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6abd1edc, atime: 0x6abd1edc, ctime: 0x6abd1edc, blocks: 0x8 00010000:00010000:3.0:1790779101.409780:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b71c065/0xb1aa4014e936db7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.409798:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790779101.409802:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779101.409810:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b71c065/0xb1aa4014e936db7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.409827:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b71c065/0xb1aa4014e936db7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.409851:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b71c065/0xb1aa4014e936db7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.409859:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b71c065/0xb1aa4014e936db7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.409911:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790779101.410122:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3649:x1877767663799680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 428us (5028us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790779101.410130:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000004:00080000:3.0:1790779101.410192:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603bd0e00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1790779101.410199:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663799680:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1790779101.412727:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779101.412744:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b71c065/0xb1aa4014e936db7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.412758:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779101.412763:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b71c065/0xb1aa4014e936db7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.412774:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b71c065/0xb1aa4014e936db7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.412797:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b71c065/0xb1aa4014e936db7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.412804:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b71c065/0xb1aa4014e936db7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.412829:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779101.412831:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779101.412832:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779101.419443:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1877767663799808:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779101.419476:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779101.433950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779101.433988:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.434103:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642782592 00000100:00100000:0.0:1790779101.434113:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642782720 00000100:00100000:1.0:1790779101.434115:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642782592 00000100:00100000:0.0:1790779101.434117:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642782720 00010000:00010000:0.0:1790779101.434156:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936d92b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a89 expref: 8 pid: 8440 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779101.434178:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00100000:1.0:1790779101.434188:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+21:12449:x1877767642782592:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00000100:00100000:0.0:1790779101.434189:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 100 00000100:00100000:0.0:1790779101.434209:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2400:x1877767642782720:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779101.434223:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779101.434229:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936d92b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a89 expref: 8 pid: 8440 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.434235:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779101.434241:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936d92b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a89 expref: 8 pid: 8440 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.434254:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936db62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b23 expref: 21 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.434256:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936d92b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a89 expref: 8 pid: 8440 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.434274:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779101.434276:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:0.0:1790779101.434278:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779101.434280:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790779101.434283:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.434293:0:6509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.434307:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.434316:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779101.434320:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.434327:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.434365:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642782720:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 156us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779101.434372:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 100 00000004:00010000:1.0:1790779101.434453:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000597c5550 reply state 000000007e20d2b0 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.434465:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.434472:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:1.0:1790779101.434474:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779101.434477:0:6523:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779101.434538:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+22:12449:x1877767642782592:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 351us (595us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1790779101.434556:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 244 00010000:00010000:2.0:1790779101.434631:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.434641:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.434657:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.434666:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.434688:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790779101.434851:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663799424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32933us (33079us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1790779101.434859:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1790779101.435421:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779101.435428:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.435438:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779101.435443:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.435462:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.435478:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.435485:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936db77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.435503:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779101.435505:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779101.435507:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779101.435941:0:3652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1790779101.435948:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1790779101.435967:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603843480, transno 4294967322 00000100:00100000:0.0:1790779101.435989:0:3652:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9b7603840000 x1877767663799424/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790779117 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1790779101.436002:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603840000/2, rc 0, transno 4294967323 00000100:00100000:0.0:1790779101.436007:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663799424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790779101.443675:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779101.443844:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642782848 00000100:00100000:3.0:1790779101.443856:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642782848 00000100:00100000:3.0:1790779101.443954:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:3.0:1790779101.443965:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2398:x1877767642782848:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790779101.444368:0:8855:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790779101.444373:0:8855:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1790779101 -> 1790779100 00002000:00010000:3.0:1790779101.444375:0:8855:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1790779100 00002000:00010000:3.0:1790779101.444378:0:8855:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790779101 -> 1790779100 00002000:00010000:3.0:1790779101.444380:0:8855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1790779101.444442:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2398:x1877767642782848:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 478us (779us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1790779101.444450:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:2.0:1790779101.469141:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779101.469284:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642783104 00000100:00100000:3.0:1790779101.469295:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642783104 00000100:00100000:3.0:1790779101.469360:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 245 00000100:00100000:3.0:1790779101.469371:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+22:12449:x1877767642783104:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790779101.469444:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.469462:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b15 expref: 22 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.469473:0:6525:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.469510:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b15 expref: 22 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.469524:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b15 expref: 22 pid: 10428 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779101.469538:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1877767663799936:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779101.469638:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779101.487191:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1877767663799936:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779101.487223:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779101.487402:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.494527:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642783232 00000100:00100000:0.0:1790779101.494545:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642783232 00010000:00010000:0.0:1790779101.494602:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b15 expref: 23 pid: 10428 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.494724:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 101 00000100:00100000:0.0:1790779101.494735:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+23:2401:x1877767642783232:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779101.494750:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779101.494757:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b15 expref: 23 pid: 10428 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.494771:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b15 expref: 23 pid: 10428 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.494792:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b15 expref: 23 pid: 10428 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.494808:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:0.0:1790779101.494813:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.494823:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.494846:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.494914:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779101.494993:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+22:2401:x1877767642783232:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 260us (7590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779101.495001:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 101 00010000:00010000:3.0:1790779101.497518:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.497560:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.497607:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.497614:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.497622:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.497628:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779101.497633:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.497641:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.497659:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:3.0:1790779101.497662:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790779101.497679:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.497686:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662000/0xb1aa4014e936db8c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779101.497776:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+22:12449:x1877767642783104:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 28403us (28640us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790779101.497786:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 245 00000100:00100000:1.0:1790779101.500973:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779101.501903:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642783360 00000100:00100000:3.0:1790779101.501914:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642783360 00000100:00100000:3.0:1790779101.501986:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:3.0:1790779101.501997:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2398:x1877767642783360:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790779101.502064:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.502087:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 8 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.502095:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779101.502100:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790779101.502104:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.502143:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 8 pid: 8855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.502157:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 8 pid: 8855 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779101.502171:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1877767663800064:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779101.502261:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779101.506266:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779101.506407:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642783488 00000100:00100000:2.0:1790779101.506416:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642783488 00010000:00010000:2.0:1790779101.506457:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 9 pid: 8855 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779101.506499:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 102 00000100:00100000:2.0:1790779101.506510:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2400:x1877767642783488:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779101.506524:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779101.506544:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 9 pid: 8855 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.506556:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 9 pid: 8855 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.506598:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790779101.506603:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790779101.506609:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.506619:0:6509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.506641:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779101.506694:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+9:2400:x1877767642783488:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 185us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779101.506702:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 102 00010000:00010000:1.0:1790779101.511442:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd6b19c/0xb1aa4014e936db70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b31 expref: 8 pid: 8855 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779101.511468:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1877767663800064:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779101.511496:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.511508:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.511516:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.511564:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.511573:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.511581:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.511587:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779101.511591:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.511599:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.511618:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.511625:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936db93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779101.511754:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2398:x1877767642783360:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 9759us (10791us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.511764:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:3.0:1790779101.516257:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.516415:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642783744 00000100:00100000:0.0:1790779101.516425:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642783744 00000100:00100000:0.0:1790779101.516508:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 246 00000100:00100000:0.0:1790779101.516518:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+21:12449:x1877767642783744:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790779101.516592:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.516609:0:10428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425add expref: 21 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.516618:0:10428:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.516653:0:10428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425add expref: 21 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.516667:0:10428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425add expref: 21 pid: 13003 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.516680:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663800192:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779101.516761:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779101.519542:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.520528:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663800192:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779101.520551:0:10428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779101.520650:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642783872 00000100:00100000:2.0:1790779101.520659:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642783872 00010000:00010000:2.0:1790779101.520704:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425add expref: 22 pid: 13003 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779101.520783:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:2.0:1790779101.520794:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+22:2401:x1877767642783872:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779101.520814:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779101.520822:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425add expref: 22 pid: 13003 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.520835:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425add expref: 22 pid: 13003 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.520896:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936da89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425add expref: 22 pid: 13003 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.520911:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:2.0:1790779101.520917:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936daeb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b00 expref: 21 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.520927:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.520935:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.520943:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779101.520985:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779101.521222:0:10428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.521231:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.521427:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.521440:0:10428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936db54 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b1c expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.521449:0:10428:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.521480:0:10428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936db54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b1c expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.521494:0:10428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936db54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b1c expref: 22 pid: 6525 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779101.521505:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663800320:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779101.521642:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+22:2401:x1877767642783872:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 849us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779101.521652:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:1.0:1790779101.521900:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76035bd180 going to sleep for 11 seconds 00000100:00100000:1.0:1790779101.527540:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663800320:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779101.527576:0:10428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779101.529402:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.530340:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642784000 00000100:00100000:0.0:1790779101.530353:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642784000 00010000:00010000:0.0:1790779101.530405:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936db54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b1c expref: 22 pid: 6525 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.530719:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00100000:0.0:1790779101.530730:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+22:2400:x1877767642784000:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779101.530746:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779101.530755:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936db54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b1c expref: 22 pid: 6525 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.530770:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936db54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b1c expref: 22 pid: 6525 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.530794:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936db54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b1c expref: 22 pid: 6525 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.530810:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:0.0:1790779101.530816:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.530827:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.530851:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.531096:0:10428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.531107:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779101.531114:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.531168:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+21:2400:x1877767642784000:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 440us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779101.531177:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 104 00000001:00080000:1.0:1790779101.531220:0:10428:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1790779101.531558:0:10428:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1790779101.531606:0:10428:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1790779101.531867:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10428:1877767663800448:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790779101.531996:0:10428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779101.532019:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707546d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779101.532213:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663800448 00000100:00100000:2.0:1790779101.532220:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663800448 00000100:00100000:2.0:1790779101.532263:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1790779101.532272:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10428:x1877767663800448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790779101.532434:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10428:x1877767663800448:12345-0@lo:1000:mdt00_003.0 Request processed in 163us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779101.532455:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1790779101.532596:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10428:1877767663800448:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1790779101.532728:0:10428:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1790779101.532781:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10428:1877767663800576:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790779101.532820:0:10428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779101.532841:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76035bda80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779101.532856:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663800576 00000100:00100000:0.0:1790779101.532862:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663800576 00000100:00100000:0.0:1790779101.532907:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1790779101.532913:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10428:x1877767663800576:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790779101.533023:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10428:x1877767663800576:12345-0@lo:1000:mdt00_003.0 Request processed in 110us (203us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1790779101.533031:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1790779101.533460:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10428:1877767663800576:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1790779101.533499:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533510:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533518:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533524:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779101.533529:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533549:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533564:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:1.0:1790779101.533568:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779101.533572:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533578:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dba1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533601:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533608:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533613:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533618:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779101.533620:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533626:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533640:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:1.0:1790779101.533643:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779101.533649:0:10428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936daeb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b00 expref: 24 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533740:0:10428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936daeb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b00 expref: 24 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533751:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936daeb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b00 expref: 24 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.533779:0:10428:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936daeb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b00 expref: 24 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779101.533791:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663800704:192.168.203.3@tcp:105: 00000100:00100000:1.0:1790779101.533858:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707546d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790779101.537789:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10428:1877767663800704:192.168.203.3@tcp:105: 00010000:00010000:1.0:1790779101.537822:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.537833:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6200/0xb1aa4014e936dae4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.537863:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936dba8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.537926:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936dba8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.537941:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936dba8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.537951:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936dba8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.537972:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936dba8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.537979:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936dba8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.537985:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779101.537988:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936dba8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.537996:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936dba8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.538009:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:1.0:1790779101.538012:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779101.538015:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936dba8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.538020:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6400/0xb1aa4014e936dba8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.538030:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.538036:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.538053:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.538059:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779101.538068:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.538074:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.538082:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:1.0:1790779101.538084:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790779101.538087:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.538092:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936db9a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790779101.538437:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790779101.538447:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1790779101.538469:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+24:12449:x1877767642783744:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 21950us (22219us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1790779101.538480:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 246 00000020:00080000:1.0:1790779101.538486:0:10428:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790779101.538921:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:3.0:1790779101.538932:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790779101.545410:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779101.548326:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.550626:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642784128 00000100:00100000:1.0:1790779101.550642:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642784128 00000100:00100000:1.0:1790779101.551444:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642784384 00000100:00100000:1.0:1790779101.551451:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642784384 00000100:00100000:1.0:1790779101.551479:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1790779101.551489:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+25:12448:x1877767642784128:12345-192.168.203.3@tcp:49:lfs.0 00000100:00100000:1.0:1790779101.551626:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+25:12448:x1877767642784128:12345-192.168.203.3@tcp:49:lfs.0 Request processed in 138us (6228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.551634:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1790779101.551652:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:1.0:1790779101.551659:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718267450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+24:12449:x1877767642784384:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790779101.551899:0:6527:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790779101.551932:0:6527:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1790779101.551960:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dbaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.551977:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dbaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.551989:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dbaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.551998:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dbaf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.552004:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dbaf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.552012:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dbaf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.552030:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790779101.552093:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718267450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+26:12449:x1877767642784384:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 433us (3776us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1790779101.552100:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000020:00080000:1.0:1790779101.552104:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790779101.552157:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779101.552163:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dbaf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.552170:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7e00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779101.552174:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dbaf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.552189:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dbaf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.552201:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:1.0:1790779101.552204:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790779101.552208:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dbaf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.552213:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936dbaf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779101.552225:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779101.552226:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779101.552228:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779101.557372:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779101.557597:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642784640 00000100:00100000:1.0:1790779101.557607:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642784640 00000100:00100000:1.0:1790779101.557717:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 247 00000100:00100000:1.0:1790779101.557728:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+26:12448:x1877767642784640:12345-192.168.203.3@tcp:58:lfs.0 00000040:00080000:1.0:1790779101.557925:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1790779101.558021:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+26:12448:x1877767642784640:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 287us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779101.558029:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 247 00000100:00100000:2.0:1790779101.604205:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.604723:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642784768 00000100:00100000:0.0:1790779101.604739:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642784768 00000100:00100000:0.0:1790779101.604823:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 248 00000100:00100000:0.0:1790779101.604836:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+26:12451:x1877767642784768:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1790779101.604868:0:13003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779101.604947:0:13003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936dbb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b38 expref: -99 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.605223:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936dbbd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.605244:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936dbbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.605652:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936dbbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.605674:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936dbc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.605683:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936dbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.605689:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936dbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.605784:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.605798:0:13003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af9 expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.605807:0:13003:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.605850:0:13003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af9 expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.605869:0:13003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af9 expref: 27 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.605918:0:13003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13003:1877767663800832:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779101.613688:0:13003:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779101.618110:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.618188:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642785024 00000100:00100000:0.0:1790779101.618215:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642785024 00000100:00100000:0.0:1790779101.618286:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:0.0:1790779101.618297:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+28:6168:x1877767642785024:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790779101.618745:0:13003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13003:1877767663800832:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779101.618779:0:13003:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.619345:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+29:6168:x1877767642785024:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 1046us (1249us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1790779101.619356:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:3.0:1790779101.623158:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779101.623454:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642785152 00000100:00100000:0.0:1790779101.623469:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642785152 00010000:00010000:0.0:1790779101.623523:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af9 expref: 29 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779101.623694:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:0.0:1790779101.623708:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff62c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+29:2401:x1877767642785152:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779101.623727:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779101.623735:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af9 expref: 29 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.623751:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af9 expref: 29 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.623780:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662a00/0xb1aa4014e936dad6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425af9 expref: 29 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.623803:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:0.0:1790779101.623809:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.623847:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.623857:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779101.623944:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779101.624029:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff62c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+28:2401:x1877767642785152:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 324us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779101.624038:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 105 00010000:00010000:3.0:1790779101.624157:0:13003:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624166:0:13003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779101.624238:0:13003:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790779101.624243:0:13003:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779101.624283:0:13003:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624299:0:13003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624311:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936dbbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624318:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936dbbd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624325:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936dbbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624332:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779101.624337:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936dbbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624355:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936dbbd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624366:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:3.0:1790779101.624369:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779101.624375:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936dbbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624382:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769800/0xb1aa4014e936dbbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624396:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936dbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624403:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936dbc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624409:0:13003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936dbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624414:0:13003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779101.624416:0:13003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936dbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624422:0:13003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936dbc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624428:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b7603616d00) 00010000:00010000:3.0:1790779101.624430:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779101.624433:0:13003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936dbc4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624456:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936dbc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13003 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624503:0:13003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936dbb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b38 expref: 28 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624521:0:13003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b38 expref: 27 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779101.624528:0:13003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:3.0:1790779101.624531:0:13003:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779101.624533:0:13003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769600, rc 0) 00000100:00100000:3.0:1790779101.625755:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+27:12451:x1877767642784768:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 20909us (21554us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779101.625768:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 248 00000001:00080000:1.0:1790779101.815517:0:9517:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1790779101.815864:0:9517:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:1.0:1790779102.185155:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790779102.510593:0:14713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790779102.510605:0:14713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790779102.511731:0:14713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:2.0:1790779102.511746:0:14713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1790779102.568407:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790779102.568421:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790779102.568527:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790779102.568546:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790779102.568680:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663800960:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790779102.568776:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7712564000 going to sleep for 11 seconds 00000100:00100000:0.0:1790779102.573653:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1877767663800960:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790779102.581868:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779102.585615:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642785280 00000100:00100000:3.0:1790779102.585632:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642785280 00000100:00100000:3.0:1790779102.585717:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 249 00000100:00100000:3.0:1790779102.585728:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+27:12462:x1877767642785280:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790779102.585762:0:6524:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790779102.585912:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+27:12462:x1877767642785280:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 185us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779102.585920:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 249 00000100:00100000:0.0:1790779102.597152:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779102.597191:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642785536 00000100:00100000:0.0:1790779102.597199:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642785536 00000100:00100000:0.0:1790779102.597244:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00100000:0.0:1790779102.597252:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+27:12462:x1877767642785536:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779102.597272:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779102.597291:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936dbd2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b3f expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779102.597388:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936dbd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779102.597402:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936dbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779102.597413:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936dbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779102.597434:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790779102.597531:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768800/0xb1aa4014e936dbd2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b3f expref: 30 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779102.597546:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936dbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b3f expref: 29 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779102.597554:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:0.0:1790779102.597556:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790779102.597560:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768a00, rc 0) 00000100:00100000:0.0:1790779102.597610:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+29:12462:x1877767642785536:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 358us (464us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1790779102.597617:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00100000:0.0:1790779102.611436:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779102.611531:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779102.611605:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642785920 00000100:00100000:1.0:1790779102.611615:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642785920 00000100:00100000:1.0:1790779102.611677:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1790779102.611687:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+29:2398:x1877767642785920:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779102.611713:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779102.611738:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768a00/0xb1aa4014e936dbd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b3f expref: 29 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779102.611754:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:1.0:1790779102.611758:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779102.611809:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+28:2398:x1877767642785920:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 124us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779102.611817:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1790779102.613108:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642785792 00000100:00100000:2.0:1790779102.613119:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642785792 00000100:00100000:2.0:1790779102.613284:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:2.0:1790779102.613294:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+28:12462:x1877767642785792:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790779102.613373:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936dbe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779102.613389:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936dbe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779102.613400:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936dbe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779102.613556:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936dbe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779102.613564:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936dbe7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779102.613572:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936dbe7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779102.613578:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779102.613594:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936dbe7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779102.613602:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936dbe7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779102.613613:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:2.0:1790779102.613616:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790779102.613621:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936dbe7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779102.613627:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2c00/0xb1aa4014e936dbe7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779102.617318:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+29:12462:x1877767642785792:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 4016us (5880us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1790779102.617332:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 251 00000040:00080000:0.0:1790779102.617508:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790779102.617513:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790779102.618029:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790779102.618047:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790779102.621921:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779102.622015:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642786176 00000100:00100000:2.0:1790779102.622025:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642786176 00000100:00100000:2.0:1790779102.622093:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1790779102.622114:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+29:12462:x1877767642786176:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790779102.622336:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+30:12462:x1877767642786176:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 233us (423us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1790779102.622343:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:3.0:1790779102.826186:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663801088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779102.826310:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779102.826720:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663801088 00000100:00100000:2.0:1790779102.826729:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663801088 00000100:00100000:2.0:1790779102.826779:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1790779102.826788:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663801088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779102.826824:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1790779102.826931:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663801088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779102.826939:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790779102.827045:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663801088:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1790779102.889454:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790779103.208114:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779103.413813:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779103.413858:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779103.413943:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779103.413983:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779103.414006:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779103.414038:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779103.414065:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642786304 00000100:00100000:2.0:1790779103.414075:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642786304 00000100:00100000:2.0:1790779103.414121:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 391 00000100:00100000:2.0:1790779103.414131:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2398:x1877767642786304:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779103.414198:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2398:x1877767642786304:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 68us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779103.414206:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 391 00000100:00100000:0.0:1790779103.414478:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642786688 00000100:00100000:0.0:1790779103.414483:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642786688 00000100:00100000:0.0:1790779103.414523:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642786560 00000100:00100000:0.0:1790779103.414526:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642786560 00000100:00100000:0.0:1790779103.414546:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:0.0:1790779103.414554:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642786688:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779103.414586:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642786688:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 33us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779103.414603:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:0.0:1790779103.414616:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:0.0:1790779103.414621:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735f92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2398:x1877767642786560:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779103.414642:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735f92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2398:x1877767642786560:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779103.414647:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:0.0:1790779103.414814:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642786432 00000100:00100000:0.0:1790779103.414817:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642786432 00000100:00100000:0.0:1790779103.414839:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642786944 00000100:00100000:0.0:1790779103.414842:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642786944 00000100:00100000:0.0:1790779103.414853:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642786816 00000100:00100000:0.0:1790779103.414855:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642786816 00000100:00100000:0.0:1790779103.414875:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 329 00000100:00100000:0.0:1790779103.414921:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642786432:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779103.414947:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2398:x1877767642786432:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779103.414953:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 329 00000100:00100000:0.0:1790779103.414964:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 330 00000100:00100000:0.0:1790779103.414970:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642786944:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779103.414987:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642786944:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 17us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779103.414993:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 330 00000100:00100000:0.0:1790779103.415002:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 331 00000100:00100000:0.0:1790779103.415007:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642786816:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779103.415050:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2398:x1877767642786816:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 42us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779103.415057:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 331 00000100:00080000:2.0:1790779103.415598:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779103.415603:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779103.415606:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790779103.415609:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790779104.238090:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779104.364194:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779104.364216:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663801216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779104.364294:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779104.364370:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663801216 00000100:00100000:3.0:1790779104.364377:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663801216 00000100:00100000:3.0:1790779104.364435:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790779104.364446:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1877767663801216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790779104.364478:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790779104.364524:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1877767663801216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779104.364531:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1790779104.364554:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779104.364591:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663801216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779104.370714:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663801344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779104.370789:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779104.371923:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663801344 00000100:00100000:2.0:1790779104.371934:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663801344 00000100:00100000:2.0:1790779104.372014:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790779104.372035:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663801344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790779104.372059:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:0.0:1790779104.372144:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779104.379930:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663801344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7898us (9130us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779104.379967:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790779104.381768:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663801344:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1790779104.423210:0:14764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790779104.423218:0:14764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790779104.423248:0:14764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790779104.423255:0:14764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790779104.711710:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779104.711810:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642787200 00000100:00100000:2.0:1790779104.711821:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642787200 00000100:00100000:2.0:1790779104.711920:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00100000:2.0:1790779104.711932:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+30:12483:x1877767642787200:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779104.711957:0:13821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779104.711979:0:13821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936dbee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b46 expref: -99 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779104.712097:0:13821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936dbf5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779104.712114:0:13821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936dbf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779104.712126:0:13821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936dbf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779104.712137:0:13821:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790779104.712241:0:13821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2000/0xb1aa4014e936dbee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b46 expref: 33 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779104.712258:0:13821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936dbf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b46 expref: 32 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779104.712285:0:13821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:2.0:1790779104.712288:0:13821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790779104.712291:0:13821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3400, rc 0) 00000100:00100000:2.0:1790779104.712368:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+32:12483:x1877767642787200:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 438us (668us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1790779104.712375:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00080000:0.0:1790779104.712616:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779104.730311:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779104.730516:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642787328 00000100:00100000:0.0:1790779104.730528:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642787328 00000100:00100000:0.0:1790779104.730584:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:0.0:1790779104.730595:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+32:12483:x1877767642787328:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1790779104.730670:0:10428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779104.730691:0:10428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779104.730706:0:10428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779104.730746:0:10428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779104.730754:0:10428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779104.730762:0:10428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779104.730768:0:10428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779104.730788:0:10428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779104.730798:0:10428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779104.730811:0:10428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:0.0:1790779104.730814:0:10428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790779104.730819:0:10428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779104.730826:0:10428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779104.730921:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+32:12483:x1877767642787328:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 328us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779104.730928:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:2.0:1790779104.851826:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779104.852075:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642787456 00000100:00100000:1.0:1790779104.852085:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642787456 00000100:00100000:1.0:1790779104.852142:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:1.0:1790779104.852152:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2398:x1877767642787456:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:1.0:1790779104.852170:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779104.852189:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d34a260d/0xb1aa4014e936dc0a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b4d expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790779104.852215:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6abd1edc, atime: 0x6abd1edc, ctime: 0x6abd1edc, blocks: 0x8 00010000:00010000:1.0:1790779104.852245:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1790779104.852249:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779104.852260:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d34a260d/0xb1aa4014e936dc0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b4d expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779104.852276:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d34a260d/0xb1aa4014e936dc0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b4d expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779104.852289:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7c00, rc 0) 00000100:00100000:1.0:1790779104.853048:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2398:x1877767642787456:12345-192.168.203.3@tcp:101:cat.0 Request processed in 893us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779104.853058:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:0.0:1790779104.871673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779104.874224:0:14330:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642787584 00000100:00100000:2.0:1790779104.874240:0:14330:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642787584 00002000:00100000:0.0:1790779104.878275:0:14330:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9b7603bd0700 x1877767642787584/t0(0) o3->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:655/0 lens 488/0 e 0 to 0 dl 1790779115 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790779104.878290:0:14330:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603bd0700 with x1877767642787584 ext(0->4095) 00002000:00010000:0.0:1790779104.878296:0:14330:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603bd0700 00000100:00100000:0.0:1790779104.878395:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1790779104.878406:0:14330:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642787584:12345-192.168.203.3@tcp:3:cat.0 00000100:00100000:0.0:1790779104.878598:0:14330:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+8:2401:x1877767642787584:12345-192.168.203.3@tcp:3:cat.0 Request processed in 193us (6933us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790779104.878606:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00002000:00100000:0.0:1790779104.878613:0:14330:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9b7603bd0700 x1877767642787584/t0(0) o3->e5203316-d1cf-49fe-9b64-c701aab9b690@192.168.203.3@tcp:655/0 lens 488/4536 e 0 to 0 dl 1790779115 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790779104.878635:0:14330:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603bd0700 with x1877767642787584 ext(0->4095) 00002000:00010000:0.0:1790779104.878639:0:14330:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603bd0700 00010000:00010000:1.0:1790779105.256201:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779105.384268:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663801472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779105.384339:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779105.385038:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663801472 00000100:00100000:3.0:1790779105.385047:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663801472 00000100:00100000:3.0:1790779105.385098:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790779105.385123:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663801472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779105.385156:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779105.385213:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663801472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779105.385221:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790779105.385358:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663801472:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1790779105.385407:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779105.386189:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779105.386203:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663801600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790779105.386242:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779105.386375:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663801600 00000100:00100000:2.0:1790779105.386381:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663801600 00000100:00100000:2.0:1790779105.386433:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790779105.386442:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663801600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790779105.386457:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779105.386498:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663801600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779105.386504:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790779105.386535:0:3652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1790779105.386540:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1790779105.386585:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76046ced80, transno 4294967308 00000004:00080000:2.0:1790779105.386595:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1790779105.386604:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603bd0e00, transno 4294967311 00000100:00100000:2.0:1790779105.386613:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663801600:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790779105.386822:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779105.386995:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663801984:0@lo:400:kworker.0 00000100:00100000:0.0:1790779105.387040:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779105.387059:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663802496:0@lo:400:kworker.0 00000100:00100000:0.0:1790779105.387082:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779105.387096:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663803008:0@lo:400:kworker.0 00000100:00100000:0.0:1790779105.387117:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779105.387137:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790779105.387142:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663801856:0@lo:400:kworker.0 00000100:00100000:0.0:1790779105.387165:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779105.387179:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663802368:0@lo:400:kworker.0 00000100:00100000:0.0:1790779105.387198:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779105.387213:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663802880:0@lo:400:kworker.0 00000100:00100000:0.0:1790779105.387233:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779105.387353:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663802496 00000100:00100000:1.0:1790779105.387359:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663802496 00000100:00100000:1.0:1790779105.387395:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663803008 00000100:00100000:1.0:1790779105.387398:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663803008 00000100:00100000:1.0:1790779105.387410:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663801856 00000100:00100000:1.0:1790779105.387413:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663801856 00000100:00100000:1.0:1790779105.387422:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663802368 00000100:00100000:1.0:1790779105.387424:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663802368 00000100:00100000:1.0:1790779105.387434:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663802880 00000100:00100000:1.0:1790779105.387437:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663802880 00000100:00100000:1.0:1790779105.387450:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1790779105.387458:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663802496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779105.387515:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663802496:12345-0@lo:400:kworker.0 Request processed in 57us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779105.387523:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1790779105.387538:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1790779105.387544:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663803008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779105.387645:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663803008:12345-0@lo:400:kworker.0 Request processed in 101us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779105.387652:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1790779105.387666:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1790779105.387671:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663801856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779105.387698:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663801856:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779105.387704:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1790779105.387716:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1790779105.387722:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663802368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779105.387747:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663802368:12345-0@lo:400:kworker.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779105.387752:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1790779105.387764:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1790779105.387770:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663802880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779105.387795:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663802880:12345-0@lo:400:kworker.0 Request processed in 25us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779105.387800:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1790779105.387829:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663801856:0@lo:400:kworker.0 00000100:00100000:1.0:1790779105.387849:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663802368:0@lo:400:kworker.0 00000100:00100000:1.0:1790779105.387857:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663802880:0@lo:400:kworker.0 00010000:00080000:1.0:1790779105.387868:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603bd2d80 x1877767663802496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779105.387904:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663802496:0@lo:400:kworker.0 00010000:00080000:1.0:1790779105.387917:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76045fa680 x1877767663803008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779105.387925:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663803008:0@lo:400:kworker.0 00000100:00080000:1.0:1790779105.387954:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790779105.387958:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779105.390756:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663801984 00000100:00100000:2.0:1790779105.390770:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663801984 00000100:00100000:3.0:1790779105.390949:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663802112:0@lo:400:kworker.0 00000100:00100000:2.0:1790779105.390970:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1790779105.390996:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663801984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779105.391038:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779105.391115:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663801984:12345-0@lo:400:kworker.0 Request processed in 123us (4074us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779105.391123:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790779105.391127:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663802624:0@lo:400:kworker.0 00000100:00100000:2.0:1790779105.391149:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663802112 00000100:00100000:2.0:1790779105.391154:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663802112 00000100:00100000:3.0:1790779105.391158:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779105.391186:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790779105.391193:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663801728:0@lo:400:kworker.0 00000100:00100000:3.0:1790779105.391219:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779105.391242:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663802240:0@lo:400:kworker.0 00000100:00100000:3.0:1790779105.391279:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779105.391297:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663802752:0@lo:400:kworker.0 00000100:00100000:3.0:1790779105.391319:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779105.391345:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663802624 00000100:00100000:3.0:1790779105.391350:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663802624 00000100:00100000:3.0:1790779105.391380:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663802752 00000100:00100000:3.0:1790779105.391383:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663802752 00000100:00100000:3.0:1790779105.391404:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790779105.391412:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663802624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779105.391451:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663802624:12345-0@lo:400:kworker.0 Request processed in 40us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779105.391465:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790779105.391480:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790779105.391486:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3651:x1877767663802752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779105.391518:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3651:x1877767663802752:12345-0@lo:400:kworker.0 Request processed in 32us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779105.391524:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790779105.391771:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663802752:0@lo:400:kworker.0 00000100:00100000:3.0:1790779105.391786:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663802624:0@lo:400:kworker.0 00000100:00100000:3.0:1790779105.391821:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663801728 00000100:00100000:3.0:1790779105.391825:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663801728 00000100:00100000:3.0:1790779105.391850:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1790779105.391856:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663801728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779105.391912:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663801728:12345-0@lo:400:kworker.0 Request processed in 55us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779105.391918:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1790779105.391949:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663801728:0@lo:400:kworker.0 00000100:00100000:2.0:1790779105.391975:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1790779105.391990:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663802240 00000100:00100000:2.0:1790779105.391990:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663802112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779105.391996:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663802240 00000100:00100000:3.0:1790779105.392032:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1790779105.392040:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663802240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779105.392054:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663802112:12345-0@lo:400:kworker.0 Request processed in 68us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779105.392062:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1790779105.392078:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663802240:12345-0@lo:400:kworker.0 Request processed in 39us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779105.392085:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1790779105.392099:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663802240:0@lo:400:kworker.0 00000100:00100000:2.0:1790779105.392111:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663802112:0@lo:400:kworker.0 00000100:00100000:1.0:1790779105.392574:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663801984:0@lo:400:kworker.0 00000100:00100000:3.0:1790779105.896326:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779105.896372:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663803136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779105.896455:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779105.896840:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663803136 00000100:00100000:1.0:1790779105.896849:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663803136 00000100:00100000:1.0:1790779105.896920:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1790779105.896930:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663803136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790779105.896977:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790779105.897041:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663803136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779105.897048:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1790779105.897411:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663803136:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790779106.285811:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790779106.929350:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1790779106.929365:0:8432:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1790779106.929460:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1790779106.929484:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b770310f600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1790779106.929490:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b773b75b300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b770310f540 00000020:00080000:3.0:1790779106.929493:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b773b75b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7702cbe000 00000020:00080000:3.0:1790779106.929515:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1790779106.929527:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1790779106.929607:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1790779106.929711:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779106.929724:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779106.929746:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779106.929753:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779106.929758:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779106.929766:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779106.929780:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b7603616800) 00010000:00010000:1.0:1790779106.929783:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779106.929788:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779106.929795:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936db85 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779107.304712:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779107.945160:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663803264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779107.945239:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779107.945385:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663803264 00000100:00100000:2.0:1790779107.945393:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663803264 00000100:00100000:2.0:1790779107.945450:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1790779107.945460:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663803264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779107.945492:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1790779107.945541:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663803264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779107.945548:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1790779107.945802:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663803264:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790779108.329418:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779108.538285:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779108.538324:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779108.538361:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779108.538377:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642787968 00000100:00100000:2.0:1790779108.538388:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642787968 00000100:00100000:0.0:1790779108.538390:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779108.538421:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779108.538565:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642787712 00000100:00100000:1.0:1790779108.538570:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642787712 00000100:00100000:0.0:1790779108.538592:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642788224 00000100:00100000:0.0:1790779108.538609:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642788224 00000100:00100000:1.0:1790779108.538611:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 393 00000100:00100000:1.0:1790779108.538623:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642787712:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779108.538649:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:0.0:1790779108.538659:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642788224:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779108.538694:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2400:x1877767642787712:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 73us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779108.538702:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 393 00000100:00100000:0.0:1790779108.538925:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642788224:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 267us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779108.538933:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:0.0:1790779108.540281:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642787840 00000100:00100000:0.0:1790779108.540293:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642787840 00000100:00100000:0.0:1790779108.540364:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 338 00000100:00100000:1.0:1790779108.540378:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 339 00000100:00100000:0.0:1790779108.540379:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642787968:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779108.540396:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+18:2400:x1877767642787840:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779108.540441:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642788480 00000100:00100000:2.0:1790779108.540447:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642788480 00000100:00100000:0.0:1790779108.540448:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2400:x1877767642787968:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 75us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779108.540458:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 338 00000100:00100000:2.0:1790779108.540647:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 340 00000100:00100000:2.0:1790779108.540656:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642788480:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779108.540707:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+18:2400:x1877767642787840:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 317us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779108.540729:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 339 00000100:00100000:2.0:1790779108.540813:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642788480:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 159us (2423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779108.540820:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 340 00000100:00080000:2.0:1790779108.540839:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779108.540844:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790779108.540847:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790779108.541538:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779108.541633:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779108.541714:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642788352 00000100:00100000:0.0:1790779108.541720:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642788352 00000100:00100000:0.0:1790779108.541769:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 341 00000100:00100000:0.0:1790779108.541778:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642788352:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779108.541818:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642788352:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 42us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779108.541833:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 341 00000100:00100000:1.0:1790779108.542360:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642788096 00000100:00100000:1.0:1790779108.542366:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642788096 00000100:00100000:1.0:1790779108.542442:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:1.0:1790779108.542452:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642788096:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779108.542489:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642788096:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 40us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779108.542496:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00080000:2.0:1790779108.542611:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790779108.542616:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790779109.352670:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779109.481404:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790779109.481429:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663803392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779109.481502:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779109.481578:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663803520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779109.481603:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779109.481740:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663803392 00000100:00100000:2.0:1790779109.481749:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663803392 00000100:00100000:3.0:1790779109.482139:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663803520 00000100:00100000:3.0:1790779109.482144:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663803520 00000100:00100000:3.0:1790779109.482223:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790779109.482234:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663803520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790779109.482263:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790779109.482315:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663803520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779109.482321:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790779109.482368:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663803520:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790779109.482441:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779109.482604:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790779109.482612:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663803392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790779109.482623:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790779109.482673:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663803392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779109.482680:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790779109.482715:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1790779109.482721:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603840000, transno 4294967323 00000004:00080000:1.0:1790779109.482741:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1790779109.482770:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663803392:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790779109.482830:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790779110.380209:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779110.504444:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663803648:0@lo:400:kworker.0 00000100:00100000:0.0:1790779110.504527:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779110.504684:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663803776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790779110.504720:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779110.504784:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663803776 00000100:00100000:1.0:1790779110.504792:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663803776 00000100:00100000:1.0:1790779110.504841:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790779110.504851:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663803776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790779110.504914:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779110.504984:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663803776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779110.504993:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1790779110.505014:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779110.505045:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663803776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790779110.505079:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663803648 00000100:00100000:1.0:1790779110.505083:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663803648 00000100:00100000:1.0:1790779110.505107:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1790779110.505114:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663803648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.508418:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663803648:12345-0@lo:400:kworker.0 Request processed in 3294us (3881us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779110.508433:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1790779110.508493:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663803904:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.508545:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779110.508590:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663803904 00000100:00100000:1.0:1790779110.508597:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663803904 00000100:00100000:1.0:1790779110.508642:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1790779110.508651:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663803904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.508703:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663803904:12345-0@lo:400:kworker.0 Request processed in 53us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779110.508711:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1790779110.508751:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663803904:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.508933:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663804032:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.508984:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779110.509018:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663804032 00000100:00100000:1.0:1790779110.509023:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663804032 00000100:00100000:1.0:1790779110.509061:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1790779110.509068:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663804032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.509107:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663804032:12345-0@lo:400:kworker.0 Request processed in 39us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779110.509113:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1790779110.509141:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663804032:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.509199:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779110.509206:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663804160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779110.509235:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779110.511419:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663803648:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514146:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663804288:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514214:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779110.514268:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663804800:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514294:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779110.514315:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790779110.514321:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663804416:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514345:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779110.514348:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663804544:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514361:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663804928:0@lo:400:kworker.0 00000100:00100000:2.0:1790779110.514376:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779110.514376:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779110.514392:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663805056:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514402:0:14675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663804800 00000100:00100000:1.0:1790779110.514409:0:14675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663804800 00000100:00100000:2.0:1790779110.514411:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779110.514426:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790779110.514446:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663804672:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514449:0:14675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663804928 00000100:00100000:1.0:1790779110.514451:0:14675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663804928 00000100:00100000:1.0:1790779110.514469:0:14675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790779110.514477:0:14675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663804800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514526:0:14675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663804800:12345-0@lo:400:kworker.0 Request processed in 49us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779110.514541:0:14675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790779110.514542:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779110.514556:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663805184:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514558:0:14675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790779110.514563:0:14675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663804928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779110.514577:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779110.514588:0:14675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663804928:12345-0@lo:400:kworker.0 Request processed in 25us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779110.514594:0:14675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790779110.514601:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663804288 00000100:00100000:2.0:1790779110.514605:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663804288 00000100:00100000:1.0:1790779110.514610:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663804416 00000100:00100000:1.0:1790779110.514613:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663804416 00000100:00100000:2.0:1790779110.514629:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663804544 00000100:00100000:1.0:1790779110.514631:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790779110.514632:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663804544 00000100:00100000:1.0:1790779110.514637:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663804416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779110.514652:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663805056 00000100:00100000:2.0:1790779110.514655:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663805056 00000100:00100000:2.0:1790779110.514667:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663804672 00000100:00100000:1.0:1790779110.514668:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663804416:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779110.514669:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663804672 00000100:00100000:1.0:1790779110.514674:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790779110.514680:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663805184 00000100:00100000:2.0:1790779110.514682:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663805184 00000100:00100000:2.0:1790779110.514696:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1790779110.514700:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663804288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514710:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663804416:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514719:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663804928:0@lo:400:kworker.0 00000100:00100000:2.0:1790779110.514728:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663804288:12345-0@lo:400:kworker.0 Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779110.514728:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663804800:0@lo:400:kworker.0 00000100:00100000:2.0:1790779110.514734:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1790779110.514735:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663804288:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514783:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1790779110.514791:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663804544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.514825:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663804544:12345-0@lo:400:kworker.0 Request processed in 35us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779110.514831:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1790779110.514844:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1790779110.514856:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663805056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779110.515003:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1790779110.515010:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663804672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779110.515090:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1790779110.515101:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663805184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779110.517218:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663804160 00000100:00100000:3.0:1790779110.517233:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663804160 00000100:00100000:3.0:1790779110.517302:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790779110.517312:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663804160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779110.517337:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790779110.519654:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663804672:12345-0@lo:400:kworker.0 Request processed in 4633us (5100us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779110.519669:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:2.0:1790779110.519716:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790779110.519722:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779110.519724:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790779110.519817:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4f6d80 x1877767663804672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779110.519851:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663804672:0@lo:400:kworker.0 00000100:00100000:2.0:1790779110.519869:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663804544:0@lo:400:kworker.0 00000100:00100000:2.0:1790779110.519893:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663805056:0@lo:400:kworker.0 00000100:00100000:0.0:1790779110.520538:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663805184:12345-0@lo:400:kworker.0 Request processed in 5436us (5956us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779110.520548:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00080000:2.0:1790779110.520654:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4f7480 x1877767663805184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779110.520665:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663805184:0@lo:400:kworker.0 00000100:00100000:1.0:1790779110.526454:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663805056:12345-0@lo:400:kworker.0 Request processed in 11588us (12030us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779110.526469:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1790779110.527518:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663804160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 10204us (18277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779110.527530:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790779110.528097:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663804160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779110.857599:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779110.857699:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642788608 00000100:00100000:2.0:1790779110.857710:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642788608 00000100:00100000:2.0:1790779110.857787:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 254 00000100:00100000:2.0:1790779110.857798:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+18:12136:x1877767642788608:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1790779110.858279:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779110.859027:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e5203316-d1cf-49fe-9b64-c701aab9b690+18:12136:x1877767642788608:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 1225us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779110.859038:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 254 00000100:00100000:0.0:1790779110.863569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779110.863667:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642788736 00000100:00100000:2.0:1790779110.863677:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642788736 00000100:00100000:2.0:1790779110.863747:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 255 00000100:00100000:2.0:1790779110.863755:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:12136:x1877767642788736:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790779110.863843:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:12136:x1877767642788736:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 89us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779110.863851:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 255 00000100:00080000:1.0:1790779110.863959:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790779110.866751:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779110.866982:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642788992 00000100:00100000:0.0:1790779110.866992:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642788992 00000100:00100000:0.0:1790779110.867049:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:0.0:1790779110.867058:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+18:12136:x1877767642788992:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790779110.867311:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+19:12136:x1877767642788992:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 253us (578us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1790779110.867320:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1790779111.016173:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779111.016197:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663805312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779111.016269:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779111.016385:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663805312 00000100:00100000:1.0:1790779111.016394:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663805312 00000100:00100000:1.0:1790779111.016449:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1790779111.016459:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663805312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790779111.016494:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790779111.016544:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663805312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779111.016551:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1790779111.016596:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663805312:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790779111.400138:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790779112.104554:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790779112.424602:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790779112.872121:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790779112.872135:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790779112.872311:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:0.0:1790779112.872320:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1790779112.874389:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1790779112.874411:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1790779112.874458:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1790779112.874473:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1790779113.067148:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663805440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779113.067269:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779113.067382:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663805440 00000100:00100000:2.0:1790779113.067392:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663805440 00000100:00100000:2.0:1790779113.067456:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790779113.067467:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663805440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779113.067520:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1790779113.067584:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663805440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779113.067593:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790779113.067655:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663805440:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1790779113.299800:0:14962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:38:31 (1790779111) 00010000:00010000:1.0:1790779113.451076:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779113.653549:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779113.653602:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779113.653632:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779113.653663:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779113.653685:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779113.653728:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642789120 00000100:00100000:0.0:1790779113.653728:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779113.653742:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642789120 00000100:00100000:0.0:1790779113.653758:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779113.653784:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642789632 00000100:00100000:0.0:1790779113.653789:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642789632 00000100:00100000:3.0:1790779113.653816:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 395 00000100:00100000:3.0:1790779113.653835:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642789120:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779113.653839:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642789504 00000100:00100000:1.0:1790779113.653842:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642789248 00000100:00100000:0.0:1790779113.653843:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642789504 00000100:00100000:1.0:1790779113.653850:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642789248 00000100:00100000:0.0:1790779113.653874:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:0.0:1790779113.653906:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642789632:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779113.653910:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642789376 00000100:00100000:1.0:1790779113.653914:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642789376 00000100:00100000:1.0:1790779113.653942:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642789888 00000100:00100000:1.0:1790779113.653945:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642789888 00000100:00100000:3.0:1790779113.653965:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2401:x1877767642789120:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 137us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779113.653969:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642789632:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 86us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779113.653984:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:3.0:1790779113.653985:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 395 00000100:00100000:2.0:1790779113.654009:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642789760 00000100:00100000:0.0:1790779113.654009:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:0.0:1790779113.654019:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642789504:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779113.654036:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 348 00000100:00100000:3.0:1790779113.654045:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+18:2400:x1877767642789248:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779113.654055:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2400:x1877767642789504:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 38us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779113.654062:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:3.0:1790779113.654088:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5203316-d1cf-49fe-9b64-c701aab9b690+18:2400:x1877767642789248:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 43us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779113.654092:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 349 00000100:00100000:3.0:1790779113.654101:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 348 00000100:00100000:0.0:1790779113.654106:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642789376:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779113.654141:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2401:x1877767642789376:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 39us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779113.654147:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 349 00000100:00080000:0.0:1790779113.654175:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790779113.654180:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779113.654184:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790779113.654186:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779113.654492:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 350 00000100:00100000:1.0:1790779113.654500:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642789888:12345-192.168.203.3@tcp:400:kworker.0 00000100:00080000:0.0:1790779113.654501:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779113.654550:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2401:x1877767642789888:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 42us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779113.654558:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 350 00000100:00100000:2.0:1790779113.654785:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642789760 00000100:00080000:0.0:1790779113.654831:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779113.654840:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 351 00000100:00100000:2.0:1790779113.654848:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642789760:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779113.654923:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2400:x1877767642789760:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 71us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779113.654931:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 351 00010000:00010000:0.0:1790779114.473411:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779114.601026:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663805568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779114.601121:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779114.601644:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779114.601654:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663805696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779114.601686:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779114.601725:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663805568 00000100:00100000:0.0:1790779114.601735:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663805568 00000100:00100000:0.0:1790779114.601801:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663805696 00000100:00100000:0.0:1790779114.601805:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663805696 00000100:00100000:0.0:1790779114.601829:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790779114.601839:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663805568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779114.601908:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1790779114.601954:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790779114.601967:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663805696:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779114.601973:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663805568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (852us total) trans 0 rc 0/0 00002000:00000024:1.0:1790779114.601980:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790779114.601982:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1790779114.602008:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779114.602009:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663805696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779114.602015:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790779114.602051:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663805696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779114.602073:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663805568:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790779115.502934:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779115.626210:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779115.626241:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663805824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779115.626331:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779115.626421:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663805824 00000100:00100000:1.0:1790779115.626431:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663805824 00000100:00100000:1.0:1790779115.626499:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790779115.626512:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663805824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790779115.626551:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779115.626603:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663805824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779115.626612:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1790779115.626637:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779115.626682:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663805824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779115.626900:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779115.626912:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663805952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779115.626960:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.627055:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663805952 00000100:00100000:3.0:1790779115.627060:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663805952 00000100:00100000:3.0:1790779115.627096:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790779115.627104:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663805952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790779115.627117:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779115.627159:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663805952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779115.627190:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790779115.627226:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663805952:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790779115.627288:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779115.629424:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663806208:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.629510:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.629547:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663806720:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.629564:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.629592:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663807232:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.629609:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.629632:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790779115.629638:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663806080:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.629664:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.629682:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663806592:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.629703:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.629719:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663807104:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.629742:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.629786:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663806208 00000100:00100000:3.0:1790779115.629796:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663806208 00000100:00100000:3.0:1790779115.629845:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663806720 00000100:00100000:3.0:1790779115.629848:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663806720 00000100:00100000:3.0:1790779115.629906:0:13821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663807232 00000100:00100000:3.0:1790779115.629909:0:13821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663807232 00000100:00100000:3.0:1790779115.629948:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1790779115.629958:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663806208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630036:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663806208:12345-0@lo:400:kworker.0 Request processed in 78us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779115.630059:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1790779115.630079:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1790779115.630085:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663806720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630118:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663806720:12345-0@lo:400:kworker.0 Request processed in 33us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779115.630124:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1790779115.630135:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1790779115.630141:0:13821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663807232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630167:0:13821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663807232:12345-0@lo:400:kworker.0 Request processed in 26us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779115.630172:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1790779115.630203:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663806592 00000100:00100000:3.0:1790779115.630206:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663806592 00000100:00100000:3.0:1790779115.630234:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1790779115.630240:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663806592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630272:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663806592:12345-0@lo:400:kworker.0 Request processed in 32us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779115.630277:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1790779115.630294:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663807104 00000100:00100000:3.0:1790779115.630297:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663807104 00000100:00100000:3.0:1790779115.630322:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790779115.630328:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663807104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630358:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663807104:12345-0@lo:400:kworker.0 Request processed in 30us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779115.630364:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1790779115.630403:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779115.630418:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663806336:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630447:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.630466:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663806848:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630485:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.630500:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663807360:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630520:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.630538:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790779115.630545:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663806464:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630565:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.630578:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663806976:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630600:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779115.630622:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663806848 00000100:00100000:3.0:1790779115.630626:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663806848 00000100:00100000:3.0:1790779115.630651:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663807360 00000100:00100000:3.0:1790779115.630654:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663807360 00000100:00100000:3.0:1790779115.630669:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663806464 00000100:00100000:3.0:1790779115.630671:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663806464 00000100:00100000:3.0:1790779115.630683:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1790779115.630689:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663806848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630721:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663806848:12345-0@lo:400:kworker.0 Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779115.630726:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1790779115.630738:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1790779115.630743:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663807360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630765:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663807360:12345-0@lo:400:kworker.0 Request processed in 23us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779115.630781:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1790779115.630792:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1790779115.630798:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663806464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630828:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663806464:12345-0@lo:400:kworker.0 Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779115.630834:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:3.0:1790779115.630852:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790779115.630860:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663806336 00000100:00100000:3.0:1790779115.630863:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663806336 00000100:00100000:3.0:1790779115.630914:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1790779115.630921:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663806336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.630962:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663806336:12345-0@lo:400:kworker.0 Request processed in 42us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779115.630968:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1790779115.631021:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663806592:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.631036:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663807104:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.631048:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663806208:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.631057:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663806720:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.631068:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663807232:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.631109:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663806464:0@lo:400:kworker.0 00000100:00100000:3.0:1790779115.631118:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663806336:0@lo:400:kworker.0 00010000:00080000:3.0:1790779115.631131:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a3f100 x1877767663806848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779115.631148:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663806848:0@lo:400:kworker.0 00010000:00080000:3.0:1790779115.631161:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a3d500 x1877767663807360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779115.631169:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663807360:0@lo:400:kworker.0 00000100:00100000:0.0:1790779115.631264:0:14675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663806976 00000100:00100000:0.0:1790779115.631268:0:14675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663806976 00000100:00100000:0.0:1790779115.631302:0:14675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790779115.631309:0:14675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663806976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779115.631359:0:14675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663806976:12345-0@lo:400:kworker.0 Request processed in 51us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779115.631366:0:14675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790779115.631392:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663806976:0@lo:400:kworker.0 00000100:00100000:1.0:1790779115.631521:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663806080 00000100:00100000:1.0:1790779115.631531:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663806080 00000100:00100000:1.0:1790779115.631573:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1790779115.631580:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663806080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779115.631623:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663806080:12345-0@lo:400:kworker.0 Request processed in 44us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779115.631629:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1790779115.631678:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663806080:0@lo:400:kworker.0 00000100:00100000:0.0:1790779116.136494:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779116.136532:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663807488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779116.136633:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779116.136772:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663807488 00000100:00100000:3.0:1790779116.136801:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663807488 00000100:00100000:3.0:1790779116.136920:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1790779116.136941:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663807488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779116.136989:0:6529:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790779116.137305:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663807488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 365us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779116.137312:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790779116.137551:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663807488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779116.156608:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779116.156740:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642790016 00000100:00100000:0.0:1790779116.156752:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642790016 00000100:00100000:0.0:1790779116.156846:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 256 00000100:00100000:0.0:1790779116.156870:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+5:13155:x1877767642790016:12345-192.168.203.3@tcp:101:lsof.0 00010000:00010000:0.0:1790779116.156941:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779116.156967:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936dc11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b54 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779116.157041:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779116.157056:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779116.157069:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779116.157118:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790779116.157122:0:6525:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779116.157160:0:6525:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779116.157203:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936dc11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b54 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779116.157222:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b54 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779116.157230:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b76026e7b00) 00010000:00010000:0.0:1790779116.157233:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790779116.157236:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768000, rc 0) 00000100:00100000:0.0:1790779116.157303:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b44070bd-520a-4282-a6d8-dd7e751e819e+6:13155:x1877767642790016:12345-192.168.203.3@tcp:101:lsof.0 Request processed in 448us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779116.157311:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 256 00000100:00080000:3.0:1790779116.157610:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790779116.520718:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779117.545095:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779118.184113:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663807616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779118.184189:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779118.184361:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663807616 00000100:00100000:3.0:1790779118.184371:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663807616 00000100:00100000:3.0:1790779118.184431:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1790779118.184441:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663807616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790779118.184485:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1790779118.184578:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663807616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779118.184589:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790779118.184630:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663807616:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790779118.568776:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779118.758821:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779118.759328:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642790272 00000100:00100000:1.0:1790779118.759338:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642790272 00000100:00100000:1.0:1790779118.759416:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:1.0:1790779118.759426:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+18:13157:x1877767642790272:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:1.0:1790779118.759689:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+19:13157:x1877767642790272:12345-192.168.203.3@tcp:35:umount.0 Request processed in 264us (877us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1790779118.759698:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00080000:3.0:1790779118.764602:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779118.767053:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779118.767626:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642790528 00000100:00100000:1.0:1790779118.767638:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642790528 00000100:00100000:1.0:1790779118.767701:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:1.0:1790779118.767711:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+19:13157:x1877767642790528:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:1.0:1790779118.768045:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+20:13157:x1877767642790528:12345-192.168.203.3@tcp:35:umount.0 Request processed in 334us (1000us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1790779118.768053:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:2.0:1790779118.773382:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779118.773426:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779118.773454:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779118.773492:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779118.773510:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779118.773534:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779118.773614:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642790784 00000100:00100000:3.0:1790779118.773624:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642790784 00000100:00100000:3.0:1790779118.773702:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642791296 00000100:00100000:3.0:1790779118.773705:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642791296 00000100:00100000:3.0:1790779118.773728:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642791168 00000100:00100000:3.0:1790779118.773731:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642791168 00000100:00100000:3.0:1790779118.773756:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 358 00000100:00100000:3.0:1790779118.773766:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642790784:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779118.773838:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642790784:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 73us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779118.773846:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 358 00000100:00100000:3.0:1790779118.773864:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 359 00000100:00100000:3.0:1790779118.773870:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642791296:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779118.773942:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2399:x1877767642791296:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 71us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779118.773949:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 359 00000100:00100000:3.0:1790779118.773961:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 360 00000100:00100000:3.0:1790779118.773968:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+6:2399:x1877767642791168:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779118.773992:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+6:2399:x1877767642791168:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 24us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779118.773998:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 360 00000100:00100000:3.0:1790779118.774016:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642790656 00000100:00100000:3.0:1790779118.774020:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642790656 00000100:00100000:3.0:1790779118.774044:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 397 00000100:00100000:3.0:1790779118.774052:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642790656:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779118.774075:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2399:x1877767642790656:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779118.774094:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 397 00000100:00100000:3.0:1790779118.774124:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642791040 00000100:00100000:3.0:1790779118.774129:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642791040 00000100:00100000:3.0:1790779118.774154:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642790912 00000100:00100000:3.0:1790779118.774157:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642790912 00000100:00100000:3.0:1790779118.774174:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:3.0:1790779118.774180:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642791040:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779118.774218:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2399:x1877767642791040:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 38us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779118.774225:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:3.0:1790779118.774236:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:3.0:1790779118.774243:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2399:x1877767642790912:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779118.774267:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2399:x1877767642790912:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779118.774273:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00080000:2.0:1790779118.775084:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790779118.775097:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790779118.775100:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779118.775103:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779118.776003:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779118.776075:0:6526:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642791552 00000100:00100000:1.0:1790779118.776082:0:6526:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642791552 00000100:00100000:1.0:1790779118.776129:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:1.0:1790779118.776137:0:6526:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7718266c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+20:13157:x1877767642791552:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:1.0:1790779118.776450:0:6526:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7718266c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+21:13157:x1877767642791552:12345-192.168.203.3@tcp:35:umount.0 Request processed in 312us (452us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1790779118.776459:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:3.0:1790779118.782866:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779118.782973:0:6527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642791808 00000100:00100000:0.0:1790779118.782987:0:6527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642791808 00000100:00100000:0.0:1790779118.783042:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:0.0:1790779118.783051:0:6527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+21:13157:x1877767642791808:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:0.0:1790779118.783403:0:6527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+22:13157:x1877767642791808:12345-192.168.203.3@tcp:35:umount.0 Request processed in 352us (552us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1790779118.783412:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:2.0:1790779118.792866:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779118.793174:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779118.798280:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779118.798387:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779118.798483:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642792192 00000100:00100000:3.0:1790779118.798493:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642792192 00000100:00100000:3.0:1790779118.798550:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:3.0:1790779118.798562:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2397:x1877767642792192:12345-192.168.203.3@tcp:9:umount.0 00000020:00000080:3.0:1790779118.798595:0:8439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cf1b 00000100:00080000:3.0:1790779118.798606:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9b773b6d2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790779118.798666:0:8439:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1790779118.798839:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5203316-d1cf-49fe-9b64-c701aab9b690+2:2397:x1877767642792192:12345-192.168.203.3@tcp:9:umount.0 Request processed in 279us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779118.798908:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00010000:00010000:3.0:1790779118.799023:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779118.804238:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642792064 00000100:00100000:0.0:1790779118.804253:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642792064 00000100:00100000:0.0:1790779118.804381:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642791936 00000100:00100000:0.0:1790779118.804398:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642791936 00000100:00100000:2.0:1790779118.810496:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779118.810583:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642792320 00000100:00100000:1.0:1790779118.810593:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642792320 00000100:00100000:1.0:1790779118.810646:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:1.0:1790779118.810657:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0f5e17b-8b38-4652-af67-f49e83fcd571+15:2399:x1877767642792064:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779118.810675:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779118.810694:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6200/0xb1aa4014e936ce18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425787 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779118.810713:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779118.810781:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0f5e17b-8b38-4652-af67-f49e83fcd571+14:2399:x1877767642792064:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 126us (17936us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779118.810789:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:1.0:1790779118.810811:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:1.0:1790779118.810819:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0f5e17b-8b38-4652-af67-f49e83fcd571+13:2398:x1877767642791936:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779118.810827:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779118.810837:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936cbfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256ae expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779118.810858:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779118.810944:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:2398:x1877767642791936:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 125us (17770us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779118.810951:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:1.0:1790779118.810968:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:1.0:1790779118.810974:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0f5e17b-8b38-4652-af67-f49e83fcd571+11:2398:x1877767642792320:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779118.810982:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779118.810992:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cf600/0xb1aa4014e936cb40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42566f expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779118.811001:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779118.811019:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2398:x1877767642792320:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 46us (12633us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779118.811025:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:3.0:1790779118.813756:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642792704 00000100:00100000:3.0:1790779118.813772:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642792704 00000100:00100000:3.0:1790779118.813836:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:3.0:1790779118.814262:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+7:2397:x1877767642792704:12345-192.168.203.3@tcp:9:umount.0 00000020:00000080:3.0:1790779118.814294:0:8855:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936d191 00000020:00010000:3.0:1790779118.814303:0:8855:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b773f618000: total 0 00000100:00080000:3.0:1790779118.814307:0:8855:0:(import.c:65:import_set_state_nolock()) ffff9b773f619000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790779118.814357:0:8855:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1790779118.814506:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2397:x1877767642792704:12345-192.168.203.3@tcp:9:umount.0 Request processed in 661us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779118.814514:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00000020:00010000:1.0:1790779118.815055:0:6511:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b773f618000: total 0 00010000:00010000:1.0:1790779118.815096:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b773f618000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1790779118.815165:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5ea466a/0xb1aa4014e936d549 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425971 expref: 4 pid: 8855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779118.815204:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d34a260d/0xb1aa4014e936dc0a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b4d expref: 3 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779118.815220:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b773f618000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1790779118.815233:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779118.815235:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779118.815237:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779118.847039:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779118.848835:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642793728 00000100:00100000:0.0:1790779118.848851:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642793728 00000100:00100000:1.0:1790779118.849253:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 257 00000100:00100000:1.0:1790779118.849268:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+22:2397:x1877767642793728:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:1.0:1790779118.849318:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cb4e 00000020:00010000:1.0:1790779118.849334:0:13003:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b760322d000: total 0 00000100:00080000:1.0:1790779118.849339:0:13003:0:(import.c:65:import_set_state_nolock()) ffff9b760322e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790779118.849371:0:13003:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1790779118.849531:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e5203316-d1cf-49fe-9b64-c701aab9b690+21:2397:x1877767642793728:12345-192.168.203.3@tcp:39:umount.0 Request processed in 268us (2502us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1790779118.849539:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 257 00000020:00010000:2.0:1790779118.849875:0:6512:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b760322d000: total 0 00010000:00010000:2.0:1790779118.849972:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b760322d000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1790779118.850006:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:2.0:1790779118.850010:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790779118.850019:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936dbf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b46 expref: 20 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850041:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:2.0:1790779118.850044:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790779118.850048:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936d534 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42596a expref: 19 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850063:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:2.0:1790779118.850065:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790779118.850069:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936d1ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42588a expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850081:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:2.0:1790779118.850083:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779118.850086:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936dbcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b38 expref: 17 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850108:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603615a00) 00010000:00010000:2.0:1790779118.850110:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779118.850114:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ce96 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42579c expref: 16 pid: 10428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850130:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:2.0:1790779118.850134:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779118.850137:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936d50a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42595c expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850148:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:2.0:1790779118.850150:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790779118.850154:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936d8ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425a66 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850166:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b76026e7b00) 00010000:00010000:2.0:1790779118.850168:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779118.850172:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936d5a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425986 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850184:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b7603615200) 00010000:00010000:2.0:1790779118.850186:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779118.850190:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769000/0xb1aa4014e936ce7a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425795 expref: 12 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850205:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b7603616300) 00010000:00010000:2.0:1790779118.850208:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790779118.850218:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936daeb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b00 expref: 11 pid: 13821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850236:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b7712a95b00) 00010000:00010000:2.0:1790779118.850239:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790779118.850242:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936d42a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425924 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850259:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b7712a96b00) 00010000:00010000:2.0:1790779118.850261:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790779118.850265:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936d5c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b42598d expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850280:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b7703991a00) 00010000:00010000:2.0:1790779118.850282:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790779118.850286:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663e00/0xb1aa4014e936cef1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4257b1 expref: 8 pid: 13003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779118.850299:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b760322d000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1790779118.850315:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779118.850317:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779118.850318:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779118.870311:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779118.870409:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642793856 00000100:00100000:1.0:1790779118.870418:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642793856 00000100:00100000:1.0:1790779118.870475:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 258 00000100:00100000:1.0:1790779118.870485:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+5:2397:x1877767642793856:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:1.0:1790779118.870518:0:6523:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cb55 00000100:00080000:1.0:1790779118.870535:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9b76035f5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790779118.870566:0:6523:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790779118.870725:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5203316-d1cf-49fe-9b64-c701aab9b690+3:2397:x1877767642793856:12345-192.168.203.3@tcp:39:umount.0 Request processed in 241us (421us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790779118.870733:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 258 00010000:00010000:2.0:1790779118.870851:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779119.592461:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779119.720188:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779119.720213:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663807744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779119.720287:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779119.720416:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663807744 00000100:00100000:0.0:1790779119.720425:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663807744 00000100:00100000:0.0:1790779119.720492:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790779119.720503:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663807744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779119.720532:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790779119.720582:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663807744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779119.720589:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790779119.720638:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663807744:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790779119.720704:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779119.720755:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779119.720766:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663807872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779119.720799:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779119.720932:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663807872 00000100:00100000:1.0:1790779119.720938:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663807872 00000100:00100000:1.0:1790779119.720974:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790779119.720981:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663807872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779119.720993:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1790779119.721059:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663807872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779119.721067:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1790779119.721084:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779119.721224:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663807872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790779120.617276:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779120.744163:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779120.744186:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663808000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779120.744288:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779120.744408:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663808000 00000100:00100000:2.0:1790779120.744417:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663808000 00000100:00100000:2.0:1790779120.744479:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790779120.744493:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663808000:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779120.744509:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663808256:0@lo:400:kworker.0 00002000:00000024:2.0:1790779120.744533:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779120.744548:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779120.744576:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663808768:0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.744585:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663808000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779120.744593:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790779120.744602:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779120.744621:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663809280:0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.744627:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663808384:0@lo:400:kworker.0 00000100:00100000:0.0:1790779120.744645:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779120.744666:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779120.744670:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790779120.744679:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663808128:0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.744691:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663808896:0@lo:400:kworker.0 00000100:00100000:0.0:1790779120.744714:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779120.744726:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779120.744742:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663809408:0@lo:400:kworker.0 00000100:00100000:0.0:1790779120.744761:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663808640:0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.744768:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779120.744794:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779120.744813:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663808000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779120.744819:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663809152:0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.744832:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790779120.744841:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663808512:0@lo:400:kworker.0 00000100:00100000:0.0:1790779120.744847:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779120.744873:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779120.744944:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663809024:0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.744965:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779120.744980:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663809536:0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.745000:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779120.745028:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663808256 00000100:00100000:2.0:1790779120.745033:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663808256 00000100:00100000:0.0:1790779120.745047:0:6515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663808128 00000100:00100000:0.0:1790779120.745060:0:6515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663808128 00000100:00100000:2.0:1790779120.745071:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663808768 00000100:00100000:2.0:1790779120.745077:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663808768 00000100:00100000:0.0:1790779120.745096:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1790779120.745099:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663809280 00000100:00100000:2.0:1790779120.745103:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663809280 00000100:00100000:0.0:1790779120.745108:0:6515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663808128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.745121:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663808896 00000100:00100000:2.0:1790779120.745124:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663808896 00000100:00100000:2.0:1790779120.745140:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663809408 00000100:00100000:2.0:1790779120.745143:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663809408 00000100:00100000:0.0:1790779120.745151:0:6515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3110940-f102-4234-a689-7d64ccf7427e+24:3650:x1877767663808128:12345-0@lo:400:kworker.0 Request processed in 46us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779120.745156:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663808512 00000100:00100000:2.0:1790779120.745159:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663808512 00000100:00100000:2.0:1790779120.745170:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1790779120.745176:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663808256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.745210:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663808256:12345-0@lo:400:kworker.0 Request processed in 34us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779120.745216:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1790779120.745230:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1790779120.745236:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663808768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.745261:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663808768:12345-0@lo:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779120.745267:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1790779120.745279:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1790779120.745285:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663809280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.745311:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663809280:12345-0@lo:400:kworker.0 Request processed in 26us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779120.745316:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1790779120.745327:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1790779120.745333:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663808896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.745363:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663808896:12345-0@lo:400:kworker.0 Request processed in 31us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779120.745374:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1790779120.745386:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1790779120.745392:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663809408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.745421:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663809408:12345-0@lo:400:kworker.0 Request processed in 29us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779120.745426:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1790779120.745437:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1790779120.745443:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663808512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.745468:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663808512:12345-0@lo:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779120.745473:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1790779120.745502:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663808512:0@lo:400:kworker.0 00010000:00080000:2.0:1790779120.745516:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76044ca680 x1877767663808896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779120.745526:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663808896:0@lo:400:kworker.0 00010000:00080000:2.0:1790779120.745535:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76044c8000 x1877767663809408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779120.745542:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663809408:0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.745580:0:14675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663809152 00000100:00100000:2.0:1790779120.745584:0:14675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663809152 00000100:00100000:0.0:1790779120.746014:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:1.0:1790779120.746018:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790779120.746025:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790779120.746028:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779120.746063:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663808128:0@lo:400:kworker.0 00000100:00100000:0.0:1790779120.746075:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663808256:0@lo:400:kworker.0 00000100:00100000:0.0:1790779120.746085:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663808768:0@lo:400:kworker.0 00000100:00100000:0.0:1790779120.746096:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663809280:0@lo:400:kworker.0 00000100:00100000:0.0:1790779120.746110:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790779120.746120:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663809664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779120.746150:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779120.746172:0:14675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663809024 00000100:00100000:2.0:1790779120.746177:0:14675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663809024 00000100:00100000:3.0:1790779120.746259:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663808384 00000100:00100000:3.0:1790779120.746263:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663808384 00000100:00100000:3.0:1790779120.746282:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663808640 00000100:00100000:3.0:1790779120.746285:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663808640 00000100:00100000:3.0:1790779120.746297:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1790779120.746304:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663808384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779120.746353:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663808384:12345-0@lo:400:kworker.0 Request processed in 49us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779120.746359:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1790779120.746371:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1790779120.746398:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663808640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779120.746429:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663808640:12345-0@lo:400:kworker.0 Request processed in 33us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779120.746435:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1790779120.747296:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663808640:0@lo:400:kworker.0 00000100:00100000:0.0:1790779120.747523:0:8442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663809664 00000100:00100000:0.0:1790779120.747529:0:8442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663809664 00000100:00100000:0.0:1790779120.747573:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790779120.747581:0:8442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663809664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779120.747599:0:8442:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790779120.747647:0:8442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663809664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779120.747654:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1790779120.747671:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779120.747698:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663809664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790779120.747804:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663809536 00000100:00100000:1.0:1790779120.747810:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663809536 00000100:00100000:1.0:1790779120.747837:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790779120.747846:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663809152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779120.747912:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663809152:12345-0@lo:400:kworker.0 Request processed in 68us (3065us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779120.747918:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790779120.747932:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790779120.747939:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663809024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779120.747967:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663809024:12345-0@lo:400:kworker.0 Request processed in 29us (3001us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779120.747972:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790779120.747984:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790779120.747989:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663809536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779120.748011:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663809536:12345-0@lo:400:kworker.0 Request processed in 23us (3011us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779120.748017:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790779120.748041:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663809152:0@lo:400:kworker.0 00000100:00100000:1.0:1790779120.748071:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663809024:0@lo:400:kworker.0 00000100:00100000:1.0:1790779120.748090:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663809536:0@lo:400:kworker.0 00000100:00100000:1.0:1790779120.748099:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663808384:0@lo:400:kworker.0 00000100:00100000:2.0:1790779120.819567:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779120.819604:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779120.819663:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779120.819710:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642793984 00000100:00100000:3.0:1790779120.819734:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642793984 00000100:00100000:3.0:1790779120.819803:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642794112 00000100:00100000:3.0:1790779120.819807:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642794112 00000100:00100000:3.0:1790779120.819820:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642794240 00000100:00100000:3.0:1790779120.819821:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642794240 00000100:00100000:3.0:1790779120.819841:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1790779120.819852:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:2400:x1877767642793984:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790779120.819856:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00010000:00010000:3.0:1790779120.819870:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790779120.819871:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0f5e17b-8b38-4652-af67-f49e83fcd571+12:2399:x1877767642794112:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779120.819919:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779120.819926:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936cc51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256c3 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779120.819934:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cee00/0xb1aa4014e936cc58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256f4 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779120.819948:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779120.819949:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779120.820352:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+10:2400:x1877767642793984:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 501us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779120.820362:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1790779120.820380:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:3.0:1790779120.820387:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff60c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+9:2398:x1877767642794240:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779120.820399:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779120.820409:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e7600/0xb1aa4014e936ce11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425780 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779120.820419:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779120.830516:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:2399:x1877767642794112:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 10637us (10899us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779120.830519:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff60c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0f5e17b-8b38-4652-af67-f49e83fcd571+8:2398:x1877767642794240:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 10127us (10850us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779120.830537:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:1.0:1790779120.830544:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:1.0:1790779120.839543:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779120.840948:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642794496 00000100:00100000:2.0:1790779120.840963:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642794496 00000100:00100000:2.0:1790779120.841035:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 259 00000100:00100000:2.0:1790779120.841045:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+6:2397:x1877767642794496:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:2.0:1790779120.841087:0:10428:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cc66 00000020:00010000:2.0:1790779120.841105:0:10428:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b760390f000: total 0 00000100:00080000:2.0:1790779120.841110:0:10428:0:(import.c:65:import_set_state_nolock()) ffff9b760390e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790779120.841140:0:10428:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1790779120.841308:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2397:x1877767642794496:12345-192.168.203.3@tcp:39:umount.0 Request processed in 265us (1786us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1790779120.841316:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 259 00000100:00080000:0.0:1790779120.841579:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1790779120.841712:0:10339:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b760390f000: total 0 00010000:00010000:3.0:1790779120.841717:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779120.841774:0:10339:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b760390f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790779120.841803:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b76026e7b00) 00010000:00010000:3.0:1790779120.841807:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779120.841814:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768000/0xb1aa4014e936dc18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b54 expref: 4 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779120.841834:0:10339:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b760390f000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1790779120.841843:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779120.841845:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779120.841847:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779120.853338:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779120.853484:0:13003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642794624 00000100:00100000:1.0:1790779120.853494:0:13003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642794624 00000100:00080000:0.0:1790779120.853558:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779120.853577:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 260 00000100:00100000:1.0:1790779120.853588:0:13003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+5:2397:x1877767642794624:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:1.0:1790779120.853631:0:13003:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cc6d 00000100:00080000:1.0:1790779120.853641:0:13003:0:(import.c:65:import_set_state_nolock()) ffff9b7601ded800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790779120.853673:0:13003:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1790779120.853707:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779120.853826:0:13003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b44070bd-520a-4282-a6d8-dd7e751e819e+3:2397:x1877767642794624:12345-192.168.203.3@tcp:39:umount.0 Request processed in 239us (506us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790779120.853834:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 260 00000100:00100000:2.0:1790779120.892484:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779120.892626:0:6517:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642794880 00000100:00100000:3.0:1790779120.892637:0:6517:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642794880 00000100:00100000:3.0:1790779120.892694:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 399 00000100:00100000:3.0:1790779120.892704:0:6517:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+7:2397:x1877767642794880:12345-192.168.203.3@tcp:251:umount.0 00000020:00000080:3.0:1790779120.892765:0:6517:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cb2b 00000020:00010000:3.0:1790779120.892773:0:6517:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b7601de8800: total 0 00000100:00080000:3.0:1790779120.892778:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9b7601dee000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790779120.892877:0:6517:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774126cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0f5e17b-8b38-4652-af67-f49e83fcd571+3:2397:x1877767642794880:12345-192.168.203.3@tcp:251:umount.0 Request processed in 174us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779120.892923:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 399 00000020:00010000:1.0:1790779120.893623:0:6512:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b7601de8800: total 0 00010000:00010000:1.0:1790779120.893690:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b7601de8800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790779120.893751:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768e00/0xb1aa4014e936cc04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b4256b5 expref: 2 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779120.893766:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b7601de8800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1790779120.893778:0:6512:0:(genops.c:885:class_export_put()) final put ffff9b7601de8800/c0f5e17b-8b38-4652-af67-f49e83fcd571 00010000:00010000:1.0:1790779120.893802:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779120.893804:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779120.893806:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790779120.893853:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7601de8800/c0f5e17b-8b38-4652-af67-f49e83fcd571 for MGS 00000020:00000080:0.0:1790779120.893945:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7601dee000 for MGS 00000100:00100000:1.0:1790779121.256236:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779121.256269:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663809792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779121.256369:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779121.256440:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663809792 00000100:00100000:3.0:1790779121.256450:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663809792 00000100:00100000:3.0:1790779121.256521:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1790779121.256532:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663809792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779121.256604:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790779121.256676:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663809792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779121.256684:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1790779121.256756:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663809792:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790779121.640348:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790779122.088785:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790779122.088795:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790779122.088944:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1790779122.088957:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1790779122.346931:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790779122.665000:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790779122.947520:0:15158:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790779122.968148:0:15158:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1790779122.968212:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.968228:0:15158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.968237:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.968247:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.968291:0:15158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790779122.968297:0:15158:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790779122.968326:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790779122.968332:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790779122.968339:0:15158:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790779122.968370:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9b770411b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790779122.968684:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663809920:0@lo:39:umount.0 00000100:00100000:0.0:1790779122.968749:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790779122.969163:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779122.969180:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779122.969196:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779122.969201:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779122.969214:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779122.969223:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779122.969230:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790779122.969233:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790779122.969238:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790779122.969304:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779122.969313:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779122.969351:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779122.969358:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936cbd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779122.969396:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779122.969401:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779122.969404:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779122.969556:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663809920 00000100:00100000:2.0:1790779122.969567:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663809920 00000100:00100000:2.0:1790779122.969620:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1790779122.969631:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877767663809920:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790779122.969662:0:6525:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c742 00000100:00080000:2.0:1790779122.969679:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9b773428b800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790779122.969757:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3648:x1877767663809920:12345-0@lo:39:umount.0 Request processed in 128us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779122.969765:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1790779122.969774:0:6525:0:(genops.c:885:class_export_put()) final put ffff9b773428b000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1790779122.969818:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779122.969835:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663810048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779122.969866:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790779122.969974:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b770411b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790779122.969985:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663809920:0@lo:39:umount.0 00000020:00000080:2.0:1790779122.970018:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773428b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790779122.970054:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773428b800 for lustre-MDT0000 00000100:00080000:2.0:1790779122.970067:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790779122.970070:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790779122.970084:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1790779122.970573:0:6510:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663810048 00000100:00100000:3.0:1790779122.970585:0:6510:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663810048 00000100:00100000:3.0:1790779122.970655:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790779122.970666:0:6510:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+24:3652:x1877767663810048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779122.970682:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779122.970703:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cf800/0xb1aa4014e936cbda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936cbd3 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779122.970719:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779122.970802:0:6510:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3110940-f102-4234-a689-7d64ccf7427e+23:3652:x1877767663810048:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779122.970809:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790779122.970862:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663810048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779122.971306:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.971324:0:15158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.971335:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.971343:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.972051:0:15158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779122.972066:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.972075:0:15158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.972083:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972089:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779122.972090:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972103:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972115:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742148000 already unused, calling callback (ffffffffc1244c20) 00010000:00010000:2.0:1790779122.972117:0:15158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:1.0:1790779122.972120:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.972128:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972135:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779122.972146:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779122.972153:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790779122.972156:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1790779122.972197:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.972205:0:15158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.972264:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.972276:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972276:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779122.972291:0:15158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790779122.972299:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7700031000/0xb1aa4014e936c6a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.972306:0:15158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7700031000/0xb1aa4014e936c6a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.972312:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7700031000/0xb1aa4014e936c6a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972315:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.972330:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7700031000/0xb1aa4014e936c6a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972334:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7742148000/0xb1aa4014e936cbe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbe8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779122.972354:0:15158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1790779122.972362:0:15158:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1790779122.972373:0:15158:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1790779122.972376:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790779122.972382:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972400:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742149200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779122.972403:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972412:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779122.972418:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779122.972424:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790779122.972427:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1790779122.972429:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1790779122.972450:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972458:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779122.972486:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972506:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7742149200/0xb1aa4014e936cae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936caec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972519:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790779122.972524:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972530:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779122.972533:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972540:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779122.972546:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779122.972551:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790779122.972554:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790779122.972556:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790779122.972570:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972576:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779122.972582:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972589:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77055ce000/0xb1aa4014e936ce49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936ce50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972612:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779122.972617:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7700031000/0xb1aa4014e936c6a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972623:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700031000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779122.972628:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7700031000/0xb1aa4014e936c6a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972635:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7700031000/0xb1aa4014e936c6a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779122.972641:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7700031000/0xb1aa4014e936c6a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779122.972646:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790779122.972649:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1790779122.972651:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1790779122.972675:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7700031000/0xb1aa4014e936c6a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972681:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779122.972690:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7700031000/0xb1aa4014e936c6a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.972697:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7700031000/0xb1aa4014e936c6a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936c6a8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779122.972707:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663810432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779122.972712:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779122.972716:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779122.972726:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779122.972753:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663810560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779122.972785:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779122.972829:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779122.972871:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779122.972911:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663810176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779122.972940:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1790779122.973002:0:15158:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000100:00100000:1.0:1790779122.973005:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663810304:0@lo:103:ldlm_bl.0 00000020:01000000:2.0:1790779122.973009:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1790779122.973017:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779122.973025:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1790779122.973034:0:15158:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9b7603109000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:1.0:1790779122.973045:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1790779122.973047:0:15158:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9b7601dcd000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790779122.973085:0:15158:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9b770411b800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:1.0:1790779122.973090:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663810432 00000020:00080000:2.0:1790779122.973091:0:15158:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9b7734248000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000100:00100000:1.0:1790779122.973103:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663810432 00000020:00080000:2.0:1790779122.973105:0:15158:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9b760390f000 b44070bd-520a-4282-a6d8-dd7e751e819e 192.168.203.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790779122.973114:0:15158:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9b760322d000 e5203316-d1cf-49fe-9b64-c701aab9b690 192.168.203.3@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1790779122.973119:0:15158:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9b77305999c0) has exports, disconnecting them 00000020:00080000:2.0:1790779122.973123:0:15158:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b7603109000), last request at 1790779120 00000020:00000080:2.0:1790779122.973131:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936ca52 00000100:00100000:1.0:1790779122.973155:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663810560 00000100:00100000:1.0:1790779122.973160:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663810560 00000100:00100000:1.0:1790779122.973173:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663810176 00000100:00100000:1.0:1790779122.973177:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663810176 00000100:00100000:1.0:1790779122.973188:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663810304 00000100:00100000:1.0:1790779122.973190:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663810304 00000100:00100000:1.0:1790779122.973206:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790779122.973215:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+26:3650:x1877767663810432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779122.973233:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779122.973254:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6c00/0xb1aa4014e936ce50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936ce49 expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.973274:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779122.973322:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+25:3650:x1877767663810432:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779122.973332:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790779122.973372:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790779122.973384:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+24:3651:x1877767663810560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779122.973404:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779122.973414:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7700031c00/0xb1aa4014e936c6a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936c6a1 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.973426:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779122.973452:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+23:3651:x1877767663810560:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779122.973458:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790779122.973471:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790779122.973476:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+22:3651:x1877767663810176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779122.973484:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779122.973494:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cec00/0xb1aa4014e936cbe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936cbe1 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.973502:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779122.973529:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+21:3651:x1877767663810176:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (590us total) trans 0 rc 0/0 00000100:00080000:2.0:1790779122.973533:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9b760310b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790779122.973540:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790779122.973560:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790779122.973567:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+20:3649:x1877767663810304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779122.973577:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779122.973587:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6e00/0xb1aa4014e936caec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936cae5 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779122.973597:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1790779122.973612:0:15158:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b7603109000): rc 0 00000020:00000080:2.0:1790779122.973617:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b7603109000/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:1.0:1790779122.973633:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3110940-f102-4234-a689-7d64ccf7427e+19:3649:x1877767663810304:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (590us total) trans 0 rc 0/0 00000020:00080000:2.0:1790779122.973634:0:15158:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b7601dcd000), last request at 1790779120 00000020:00000080:2.0:1790779122.973646:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c92c 00000100:00080000:2.0:1790779122.973654:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9b7601dcb000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790779122.973666:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00000080:2.0:1790779122.973675:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603109000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1790779122.973720:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b760310b000 for lustre-MDT0000 00000100:00100000:1.0:1790779122.973723:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663810304:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1790779122.973742:0:15158:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b7601dcd000): rc 0 00000020:00000080:2.0:1790779122.973746:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b7601dcd000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1790779122.973757:0:15158:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b770411b800), last request at 1790778892 00010000:00010000:1.0:1790779122.973761:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790779122.973763:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c829 00000100:00080000:2.0:1790779122.973773:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9b770411f800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790779122.973787:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663810176:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1790779122.973795:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7601dcd000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1790779122.973803:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663810560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779122.973840:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790779122.973845:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7601dcb000 for lustre-MDT0000 00000020:00080000:2.0:1790779122.974546:0:15158:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b770411b800): rc 0 00000020:00000080:2.0:1790779122.974550:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b770411b800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1790779122.974563:0:15158:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b7734248000), last request at 1790778892 00000020:00000080:2.0:1790779122.974569:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c7f8 00000100:00080000:2.0:1790779122.974588:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9b77342fa000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1790779122.974617:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b770411b800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1790779122.974620:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779122.975155:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663810432:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1790779122.975764:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b770411f800 for lustre-MDT0000 00000001:00000004:2.0:1790779122.975787:0:15158:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1790779122.976005:0:15158:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b7734248000): rc 0 00000004:00000080:2.0:1790779122.976012:0:15158:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc92c808fae0 00000100:00080000:2.0:1790779122.976031:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790779122.976035:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1790779122.976911:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790779122.977133:0:15158:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1790779122.977235:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9b770eb7f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790779122.977301:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663810688:0@lo:39:umount.0 00000100:00100000:0.0:1790779122.977371:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790779122.977726:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790779122.977730:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1790779122.977748:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790779122.977803:0:15158:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790779122.977814:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9b7704184800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790779122.977846:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663810816:0@lo:9:umount.0 00000100:00100000:0.0:1790779122.977975:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779122.978019:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663810688 00000100:00100000:0.0:1790779122.978026:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663810688 00000100:00100000:0.0:1790779122.978075:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790779122.978084:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877767663810688:12345-0@lo:39:umount.0 00000020:00000080:0.0:1790779122.978111:0:6529:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c884 00000100:00080000:0.0:1790779122.978120:0:6529:0:(import.c:65:import_set_state_nolock()) ffff9b773b64d800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1790779122.978239:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790779122.978242:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1790779122.978256:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790779122.978318:0:15158:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790779122.978330:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9b76035f4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1790779122.978360:0:15158:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9b77305999c0) has no exports 00000001:00000004:0.0:1790779122.978520:0:6529:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1790779122.978699:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779122.978742:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3648:x1877767663810688:12345-0@lo:39:umount.0 Request processed in 574us (1286us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790779122.978750:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790779122.978775:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663810816 00000100:00100000:0.0:1790779122.978780:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663810816 00000100:00100000:0.0:1790779122.978813:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790779122.978819:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1877767663810816:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790779122.978834:0:8855:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c9db 00000100:00080000:0.0:1790779122.978839:0:8855:0:(import.c:65:import_set_state_nolock()) ffff9b7601e14000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1790779122.979013:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1790779122.979096:0:8855:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1790779122.979267:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3648:x1877767663810816:12345-0@lo:9:umount.0 Request processed in 448us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779122.979274:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790779122.979298:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663810944:0@lo:9:umount.0 00000100:00100000:0.0:1790779122.979325:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790779122.979362:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704184800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1790779122.979372:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790779122.979373:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790779122.979377:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663810816:0@lo:9:umount.0 00010000:00010000:2.0:1790779122.979494:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779122.979777:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790779122.979811:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b770eb7f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790779122.979817:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663810688:0@lo:39:umount.0 00000100:00100000:0.0:1790779122.979972:0:14675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663810944 00000100:00100000:0.0:1790779122.979983:0:14675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663810944 00000100:00080000:1.0:1790779122.981786:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779122.982577:0:14675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790779122.982602:0:14675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1877767663810944:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790779122.982651:0:14675:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cb16 00000100:00080000:0.0:1790779122.982680:0:14675:0:(import.c:65:import_set_state_nolock()) ffff9b7603880800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790779122.982741:0:14675:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1790779122.982985:0:14675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3648:x1877767663810944:12345-0@lo:9:umount.0 Request processed in 395us (3657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779122.982994:0:14675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1790779122.983045:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b76035f4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1790779122.983059:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790779122.983062:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790779122.983065:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663810944:0@lo:9:umount.0 00010000:00010000:0.0:1790779122.983098:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790779123.006219:0:15158:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9b77305999c0) has no exports 00000020:00000080:0.0:1790779123.075632:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c6fc 00000020:00000080:0.0:1790779123.075648:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b77041d5800/lustre-QMT0000_UUID 00000020:01000000:0.0:1790779123.075668:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1790779123.075722:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77041d5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1790779123.076593:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779123.076608:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790779123.076613:0:15158:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9b7734098000) has no exports 00000020:00000080:1.0:1790779123.086554:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c6f5 00000020:00000080:1.0:1790779123.086566:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b77340a3800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790779123.086637:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779123.086658:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1790779123.086666:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b77182bf000/lustre-QMT0000_UUID 00000020:00000080:1.0:1790779123.086669:0:15158:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77182bf000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1790779123.086680:0:15158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1790779123.087175:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77340a3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1790779123.304178:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779123.304199:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663811072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779123.304259:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779123.304362:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663811072 00000100:00100000:1.0:1790779123.304370:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663811072 00000100:00100000:1.0:1790779123.304410:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1790779123.304417:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1877767663811072:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1790779123.304424:0:6529:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790779123.304465:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1877767663811072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (205us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790779123.304472:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:02020000:0.0:1790779123.304550:0:3651:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1790779123.312495:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790779123.312505:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9b7734596800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790779123.312511:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790779123.324858:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9b7734596800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779123.324871:0:3651:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 210 00000100:00080000:0.0:1790779123.325040:0:3651:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b7734596800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779123.325115:0:3651:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b76046cf100 x1877767663811200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779123.325172:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663811200:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1790779123.325250:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779123.325395:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663811200 00000100:00100000:2.0:1790779123.325404:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663811200 00000100:00100000:2.0:1790779123.325449:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1790779123.325456:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663811200:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1790779123.325473:0:6529:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790779123.329504:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663811200:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 4037us (4243us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790779123.329519:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1790779123.330269:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7734596800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779123.330277:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790779123.330282:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663811200:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1790779123.689432:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779124.712061:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779124.840399:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663811328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779124.840483:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779124.840566:0:8441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663811328 00000100:00100000:1.0:1790779124.840575:0:8441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663811328 00000100:00100000:1.0:1790779124.840626:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790779124.840636:0:8441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663811328:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790779124.840643:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1790779124.840665:0:8441:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1790779124.840715:0:8441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663811328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779124.840721:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790779124.840935:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663811328:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1790779124.843112:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790779124.843122:0:8432:0:(genops.c:885:class_export_put()) final put ffff9b7601e12000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1790779124.843144:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000020:00000080:3.0:1790779124.843147:0:8432:0:(genops.c:885:class_export_put()) final put ffff9b773f618000/e5203316-d1cf-49fe-9b64-c701aab9b690 00000001:00100000:3.0:1790779124.843760:0:9517:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790779124.843765:0:9517:0:(genops.c:885:class_export_put()) final put ffff9b7603884000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1790779124.843776:0:9517:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000020:00000080:3.0:1790779124.843778:0:9517:0:(genops.c:885:class_export_put()) final put ffff9b773b6d4000/e5203316-d1cf-49fe-9b64-c701aab9b690 00000020:00000080:1.0:1790779124.844668:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7601e12000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790779124.844726:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773f618000/e5203316-d1cf-49fe-9b64-c701aab9b690 for lustre-OST0000 00000020:00000080:1.0:1790779124.844746:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603884000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790779124.844762:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d4000/e5203316-d1cf-49fe-9b64-c701aab9b690 for lustre-OST0001 00000020:00000080:1.0:1790779124.844778:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7601e14000 for lustre-OST0000 00000020:00000080:1.0:1790779124.844782:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773f619000 for lustre-OST0000 00000020:00000080:1.0:1790779124.844786:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7603880800 for lustre-OST0001 00000020:00000080:1.0:1790779124.844789:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773b6d2000 for lustre-OST0001 00000001:00100000:2.0:1790779124.845573:0:6502:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790779124.845580:0:6502:0:(genops.c:885:class_export_put()) final put ffff9b7734248000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1790779124.845603:0:6502:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b44070bd-520a-4282-a6d8-dd7e751e819e 00000001:00080000:2.0:1790779124.845612:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1790779124.845615:0:6502:0:(genops.c:885:class_export_put()) final put ffff9b760390f000/b44070bd-520a-4282-a6d8-dd7e751e819e 00000001:00100000:2.0:1790779124.845620:0:6502:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000001:00080000:2.0:1790779124.845625:0:6502:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1790779124.845632:0:6502:0:(genops.c:885:class_export_put()) final put ffff9b760322d000/e5203316-d1cf-49fe-9b64-c701aab9b690 00000020:00000080:0.0:1790779124.845685:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7734248000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1790779124.845742:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760390f000/b44070bd-520a-4282-a6d8-dd7e751e819e for lustre-MDT0000 00000020:00000080:0.0:1790779124.845765:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760322d000/e5203316-d1cf-49fe-9b64-c701aab9b690 for lustre-MDT0000 00000020:00000080:0.0:1790779124.845794:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b77342fa000 for lustre-MDT0000 00000020:00000080:0.0:1790779124.845798:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b760390e000 for lustre-MDT0000 00000020:00000080:0.0:1790779124.845803:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b760322e800 for lustre-MDT0000 00000001:00100000:0.0:1790779124.847190:0:7455:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790779124.847203:0:7455:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1790779124.847207:0:7455:0:(genops.c:885:class_export_put()) final put ffff9b773b547800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790779124.847228:0:7455:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b44070bd-520a-4282-a6d8-dd7e751e819e 00000001:00080000:0.0:1790779124.847233:0:7455:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1790779124.847235:0:7455:0:(genops.c:885:class_export_put()) final put ffff9b7601de8000/b44070bd-520a-4282-a6d8-dd7e751e819e 00000001:00100000:0.0:1790779124.847239:0:7455:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e5203316-d1cf-49fe-9b64-c701aab9b690 00000001:00080000:0.0:1790779124.847242:0:7455:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1790779124.847244:0:7455:0:(genops.c:885:class_export_put()) final put ffff9b760322e000/e5203316-d1cf-49fe-9b64-c701aab9b690 00000020:00000080:1.0:1790779124.847514:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b547800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1790779124.847567:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7601de8000/b44070bd-520a-4282-a6d8-dd7e751e819e for lustre-MDT0001 00000020:00000080:1.0:1790779124.847596:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760322e000/e5203316-d1cf-49fe-9b64-c701aab9b690 for lustre-MDT0001 00000020:00000080:1.0:1790779124.847618:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773b64d800 for lustre-MDT0001 00000020:00000080:1.0:1790779124.847635:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7601ded800 for lustre-MDT0001 00000020:00000080:1.0:1790779124.847639:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b76035f5800 for lustre-MDT0001 00000020:01000000:2.0:1790779125.096237:0:15158:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b76032812a0 - data ffff9b770e1aa870/ffff9b76035d8000 00000020:01000000:2.0:1790779125.097152:0:15158:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b7711b663c0 - data ffff9b770e0bf6c0/ffff9b77341c0c00 00000001:00000004:2.0:1790779125.105603:0:15158:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1790779125.189554:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790779125.189651:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1790779125.189667:0:15158:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9b7603009880 x1877767663810688/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790779132 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779125.189691:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1790779125.191032:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790779125.191038:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1790779125.191052:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779125.191055:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790779125.191767:0:8852:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790779125.191773:0:8852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1790779125.191785:0:8852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1790779125.192651:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790779125.192659:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1790779125.192668:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779125.192671:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790779125.193777:0:10059:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790779125.193783:0:10059:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1790779125.193796:0:10059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1790779125.196786:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c6c4 00000020:00000080:3.0:1790779125.196797:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b771270b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790779125.197572:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b771270b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790779125.199747:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c6d9 00000020:00000080:3.0:1790779125.199764:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b77041d3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790779125.200186:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1790779125.200192:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779125.200202:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790779125.200206:0:15158:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9b7730598000) has no exports 00000004:01000000:3.0:1790779125.200402:0:15158:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790779125.200411:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cb0f 00000020:00000080:3.0:1790779125.200416:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b760322d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790779125.200601:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77041d3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790779125.200985:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790779125.200993:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779125.201005:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790779125.201009:0:15158:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff9b773b783380) has no exports 00000020:00000080:3.0:1790779125.201016:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cb08 00000020:00000080:3.0:1790779125.201022:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b76035f5000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790779125.201046:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760322d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1790779125.202084:0:15158:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790779125.202091:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790779125.202107:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1790779125.202115:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779125.202119:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790779125.202162:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779125.202175:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790779125.202184:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c9cd 00000020:00000080:3.0:1790779125.202192:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b7601e11800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790779125.202198:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790779125.202202:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779125.202208:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790779125.202211:0:15158:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9b7735a6cd40) has no exports 00000020:00000080:3.0:1790779125.202217:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c9c6 00000020:00000080:3.0:1790779125.202220:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b773b4b7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790779125.202410:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b76035f5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790779125.202496:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b76035f4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790779125.202505:0:36:0:(genops.c:885:class_export_put()) final put ffff9b76035f2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790779125.202507:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b76035f2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1790779125.202513:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790779125.202754:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7601e11800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790779125.202760:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b4b7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1790779125.203864:0:15158:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790779125.204024:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790779125.204030:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1790779125.204037:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779125.204040:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790779125.204094:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779125.204107:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1790779125.204124:0:15158:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1790779125.204132:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c87d 00000020:00000080:3.0:1790779125.204141:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b77342f8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790779125.204147:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1790779125.204152:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779125.204158:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790779125.204161:0:15158:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9b77411699c0) has no exports 00000020:00000080:3.0:1790779125.204168:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c876 00000020:00000080:3.0:1790779125.204172:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b7704185000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790779125.205207:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7704184800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790779125.205221:0:36:0:(genops.c:885:class_export_put()) final put ffff9b773b6d5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790779125.205224:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790779125.205232:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790779125.208405:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77342f8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790779125.208432:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704185000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1790779125.234066:0:15158:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1790779125.234076:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790779125.234080:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1790779125.234098:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790779125.234185:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779125.234199:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790779125.234382:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b770eb7f800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790779125.234393:0:36:0:(genops.c:885:class_export_put()) final put ffff9b77342fe800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790779125.234396:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77342fe800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1790779125.234408:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790779125.234685:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779125.234691:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790779125.234817:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b7712709000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790779125.234821:0:15158:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7712709000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790779125.234829:0:15158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790779125.234969:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c6e0 00000020:00000080:3.0:1790779125.234976:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b77041d7800/lustre-MDD0000_UUID 00000020:01000000:3.0:1790779125.234987:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1790779125.234991:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779125.234997:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790779125.235000:0:15158:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9b77041c8000) has no exports 00000020:00000080:3.0:1790779125.235021:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779125.235024:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1790779125.235028:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c6e7 00000020:00000080:3.0:1790779125.235032:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b77041d1800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1790779125.235039:0:15158:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b77208a9000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1790779125.235042:0:15158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b77208a9000 3 00000020:01000004:3.0:1790779125.235046:0:15158:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b77208a9000 from lustre-MDT0000 00000020:00000080:3.0:1790779125.235067:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779125.235070:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1790779125.235072:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b7712709800/lustre-MDT0000_UUID 00000020:00000080:3.0:1790779125.235074:0:15158:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7712709800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1790779125.235080:0:15158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1790779125.235110:0:15158:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1790779125.235114:0:15158:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1790779125.235117:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1790779125.235119:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779125.235122:0:15158:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790779125.235128:0:15158:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9b771828d800 d3110940-f102-4234-a689-7d64ccf7427e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790779125.235141:0:15158:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9b774116b380) has exports, disconnecting them 00000020:00080000:3.0:1790779125.235146:0:15158:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b771828d800), last request at 1790778871 00000020:00000080:3.0:1790779125.235160:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c685 00000020:00010000:3.0:1790779125.235164:0:15158:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b771828d800: total 2 00000100:00080000:3.0:1790779125.235167:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9b771828f000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1790779125.235238:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77041d7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1790779125.235243:0:36:0:(genops.c:885:class_export_put()) final put ffff9b771270b800/lustre-MDD0000_UUID 00000020:00000080:1.0:1790779125.235245:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b771270b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790779125.235249:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1790779125.235293:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77041d1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1790779125.235404:0:15158:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b771828d800): rc 0 00000020:00080000:3.0:1790779125.235409:0:15158:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9b774116b380) has no exports 00000100:00100000:3.0:1790779125.235546:0:6517:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b771db34800:6517] 1 exiting: rc = 0 00000100:00100000:2.0:1790779125.235918:0:6518:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b7741162800:6518] 2 exiting: rc = 0 00000100:00100000:1.0:1790779125.236239:0:6515:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b7741165800:6515] 0 exiting: rc = 1 00000020:00010000:0.0:1790779125.236335:0:6512:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b771828d800: total 0 00010000:00010000:0.0:1790779125.236380:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b771828d800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1790779125.236411:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2600/0xb1aa4014e936cba2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936cb9b expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236438:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77055cfa00/0xb1aa4014e936cb94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936cb8d expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236450:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3000/0xb1aa4014e936cbb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936cba9 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236476:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936cbbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936cbb7 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236488:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e6800/0xb1aa4014e936ce26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936ce1f expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236497:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768200/0xb1aa4014e936cbcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936cbc5 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236508:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b77089e7400/0xb1aa4014e936c781 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936c77a expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236522:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7742148600/0xb1aa4014e936c78f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936c788 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236536:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936cbf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936cbef expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236545:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2200/0xb1aa4014e936cb86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936cb7f expref: 5 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236556:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894be00/0xb1aa4014e936ce34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936ce2d expref: 4 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236566:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768600/0xb1aa4014e936ce42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936ce3b expref: 3 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236590:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936caa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936ca9f expref: 2 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779125.236612:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b771828d800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1790779125.236628:0:6512:0:(genops.c:885:class_export_put()) final put ffff9b771828d800/d3110940-f102-4234-a689-7d64ccf7427e 00010000:00010000:0.0:1790779125.236645:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779125.236647:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779125.236649:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790779125.236805:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b771828d800/d3110940-f102-4234-a689-7d64ccf7427e for MGS 00000020:00000080:1.0:1790779125.236842:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b771828f000 for MGS 00000100:00100000:3.0:1790779125.237042:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237051:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237057:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237064:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237070:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237075:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237080:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237087:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237093:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237099:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237106:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237112:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237117:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237123:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237129:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237135:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237142:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237147:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237153:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237160:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237166:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237171:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237177:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237184:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237190:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237204:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237210:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237215:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237221:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237227:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237233:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237239:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237245:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237250:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237256:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237261:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237267:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237272:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237278:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237283:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237288:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237293:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237309:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237315:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237321:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237326:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237332:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237337:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237342:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237348:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237353:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237359:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237366:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237371:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237377:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237383:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237388:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237394:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237399:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237404:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237416:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237522:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237529:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779125.237534:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1790779125.240044:0:15158:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b7735bf5ea0 - data ffff9b76020af000/ffff9b7735c65800 00000020:01000000:3.0:1790779125.240174:0:15158:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b77124517e0 - data ffff9b770e07ae58/ffff9b7708269400 00000020:00000080:3.0:1790779125.240781:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c669 00000020:00000080:3.0:1790779125.240790:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b7741298800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1790779125.240846:0:15158:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b77208a9000 from MGS, refs=2 00000020:01000004:3.0:1790779125.240851:0:15158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b77208a9000 2 00000020:01000004:3.0:1790779125.240854:0:15158:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b77208a9000 from MGS 00000020:00000080:3.0:1790779125.240902:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779125.240909:0:15158:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1790779125.240912:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b7741298000/MGS 00000020:00000080:3.0:1790779125.240915:0:15158:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7741298000/MGS for MGS 00000020:01000000:3.0:1790779125.240921:0:15158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1790779125.240983:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1790779125.240987:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779125.240992:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790779125.240999:0:15158:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b77340a1000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790779125.241005:0:15158:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9b77340f8000) has exports, disconnecting them 00000020:00080000:3.0:1790779125.241010:0:15158:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b77340a1000), last request at 1790778872 00000020:00000080:3.0:1790779125.241014:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c734 00000020:00080000:3.0:1790779125.241023:0:15158:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b77340a1000): rc 0 00000020:00000080:3.0:1790779125.241028:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b77340a1000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790779125.244746:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7741298800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790779125.244942:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77340a1000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1790779125.255961:0:15158:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1790779125.255970:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790779125.255975:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790779125.255982:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790779125.256194:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790779125.256204:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1790779125.256211:0:15158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b77208a9000 1 00000020:00000080:0.0:1790779125.256218:0:15158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c65b 00000020:00000080:0.0:1790779125.256227:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b7741299800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1790779125.256234:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1790779125.256240:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790779125.256244:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790779125.256248:0:15158:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9b773059b380) has no exports 00000020:00000080:1.0:1790779125.258735:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b770411b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790779125.258752:0:38:0:(genops.c:885:class_export_put()) final put ffff9b770411e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790779125.258756:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b770411e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790779125.258769:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1790779125.258844:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7741299800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790779125.341809:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779125.341823:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1790779125.341828:0:15158:0:(genops.c:885:class_export_put()) final put ffff9b77119ec800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790779125.341833:0:15158:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77119ec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1790779125.341841:0:15158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1790779125.341990:0:15158:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b77208ae800 00000020:02000400:2.0:1790779125.342375:0:15158:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1790779125.736813:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779125.864120:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1790779125.869982:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790779125.869990:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790779125.869994:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b7734596800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779125.870002:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 441 00000100:00080000:1.0:1790779125.870009:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790779125.870020:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b7734596800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779125.870047:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603843800 x1877767663811712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790779125.870126:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663811584:0@lo:400:kworker.0 00000400:00000100:0.0:1790779125.870177:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877767663811584 offset 0 length 224: 4 00000100:00100000:0.0:1790779125.870232:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779125.870239:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663811840:0@lo:400:kworker.0 00000100:00100000:0.0:1790779125.870291:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779125.870336:0:10428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663811840 00000100:00100000:0.0:1790779125.870343:0:10428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663811840 00000100:00100000:0.0:1790779125.870394:0:10428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790779125.870400:0:10428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1877767663811840:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790779125.870408:0:10428:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790779125.870445:0:10428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1877767663811840:12345-0@lo:400:kworker.0 Request processed in 45us (159us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790779125.870462:0:10428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:0.0:1790779125.870511:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790779125.870516:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9b77342ff000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790779125.870520:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1790779125.872795:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663811968:0@lo:400:kworker.0 00000100:00100000:3.0:1790779125.873138:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779125.873184:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663811456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779125.873210:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779125.873296:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663811968 00000100:00100000:3.0:1790779125.873305:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663811968 00000100:00100000:3.0:1790779125.873707:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790779125.873716:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1877767663811968:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790779125.873725:0:6523:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790779125.873777:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1877767663811968:12345-0@lo:400:kworker.0 Request processed in 59us (639us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790779125.873795:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:3.0:1790779125.873988:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790779125.873994:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9b7601dee800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790779125.873999:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790779125.874004:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9b7601dee800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779125.874008:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 230 00000100:00080000:3.0:1790779125.874016:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b7601dee800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779125.874046:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603a3f800 x1877767663812096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779125.874062:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663811968:0@lo:400:kworker.0 00000100:00100000:3.0:1790779125.874103:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663811712:0@lo:38:kworker.0 00000100:00100000:3.0:1790779125.874133:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779125.874151:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663812096:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1790779125.874172:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779125.874200:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663811712 00000100:00100000:3.0:1790779125.874205:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663811712 00000100:00100000:3.0:1790779125.874224:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1790779125.874229:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663811712:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790779125.874260:0:6528:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790779125.874291:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663811712:12345-0@lo:38:kworker.0 Request processed in 61us (157us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790779125.874298:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:3.0:1790779125.874320:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7734596800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790779125.874324:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790779125.874327:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663811712:0@lo:38:kworker.0 00000100:00100000:2.0:1790779125.876479:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663812096 00000100:00100000:2.0:1790779125.876498:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663812096 00000100:00100000:2.0:1790779125.876541:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790779125.876550:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663812096:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1790779125.876571:0:6525:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790779125.876654:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663812096:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 104us (2480us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790779125.876662:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1790779125.877127:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7601dee800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779125.877133:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790779125.877137:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663812096:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790779125.879230:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663812224:0@lo:400:kworker.0 00000100:00100000:1.0:1790779125.879306:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779125.879389:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779125.879397:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663812352:0@lo:400:kworker.0 00000100:00100000:1.0:1790779125.879424:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779125.879472:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663812480:0@lo:400:kworker.0 00000100:00100000:1.0:1790779125.879506:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779125.879545:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779125.879551:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663812608:0@lo:400:kworker.0 00000100:00100000:1.0:1790779125.879591:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779125.879623:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663812224 00000100:00100000:1.0:1790779125.879631:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663812224 00000100:00100000:1.0:1790779125.879679:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663812480 00000100:00100000:1.0:1790779125.879682:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663812480 00000100:00100000:1.0:1790779125.879698:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663812608 00000100:00100000:1.0:1790779125.879700:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663812608 00000100:00100000:1.0:1790779125.879724:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1790779125.879732:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663812224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779125.879799:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663812224:12345-0@lo:400:kworker.0 Request processed in 67us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779125.879807:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1790779125.879824:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1790779125.880052:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663812608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779125.880084:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663812608:12345-0@lo:400:kworker.0 Request processed in 255us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779125.880090:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1790779125.880103:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790779125.880106:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1877767663812480:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790779125.880112:0:6523:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790779125.880139:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1877767663812480:12345-0@lo:400:kworker.0 Request processed in 31us (632us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790779125.880144:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1790779125.880159:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1790779125.880196:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9b7603bd1880 x1877767663812608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779125.880212:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663812608:0@lo:400:kworker.0 00010000:00080000:1.0:1790779125.880231:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9b7735c50700 x1877767663812224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779125.880239:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663812224:0@lo:400:kworker.0 00000100:00080000:1.0:1790779125.880268:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790779125.880273:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9b7601e10800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790779125.880277:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790779125.880282:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9b7601e10800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779125.880285:0:3652:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 250 00000100:00080000:1.0:1790779125.880295:0:3652:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b7601e10800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779125.880316:0:3652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603bd1880 x1877767663812736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779125.880333:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663812480:0@lo:400:kworker.0 00000100:00100000:1.0:1790779125.880350:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663812736:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1790779125.880373:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779125.880396:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663812736 00000100:00100000:1.0:1790779125.880399:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663812736 00000100:00100000:1.0:1790779125.880415:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790779125.880419:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663812736:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1790779125.880437:0:6523:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790779125.880464:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663812736:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 43us (90us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790779125.880471:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1790779125.880634:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7601e10800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779125.880645:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790779125.880648:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663812736:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1790779125.880711:0:10360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663811456 00000100:00100000:1.0:1790779125.880716:0:10360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663811456 00000100:00100000:1.0:1790779125.880749:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790779125.880756:0:10360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663811456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790779125.880789:0:10360:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790779125.880824:0:10360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663811456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (7612us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779125.882699:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1790779125.882749:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779125.883593:0:8438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663812352 00000100:00100000:1.0:1790779125.883604:0:8438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663812352 00000100:00100000:1.0:1790779125.883663:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790779125.883673:0:8438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663812352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779125.883761:0:8438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663812352:12345-0@lo:400:kworker.0 Request processed in 89us (4335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779125.883768:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790779125.884067:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663812352:0@lo:400:kworker.0 00000100:00100000:3.0:1790779125.885662:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663811456:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790779125.891764:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9b77342ff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779125.891777:0:3651:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 210 00000100:00080000:0.0:1790779125.891801:0:3651:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b77342ff000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779125.891847:0:3651:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b76046cc700 x1877767663812864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779125.891931:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877767663812864:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1790779125.892000:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779125.892069:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663811840:0@lo:400:kworker.0 00000100:00100000:1.0:1790779125.892216:0:6525:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663812864 00000100:00100000:1.0:1790779125.892225:0:6525:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663812864 00000100:00100000:1.0:1790779125.892273:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1790779125.892280:0:6525:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663812864:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1790779125.892302:0:6525:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790779125.897804:0:6525:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663812864:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 5501us (5782us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790779125.897842:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1790779125.900056:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77342ff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779125.900068:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790779125.900073:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877767663812864:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1790779126.761268:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779127.784021:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779128.813347:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790779129.589699:0:15359:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790779129.616369:0:15359:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1790779129.616430:0:15359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.616445:0:15359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.616453:0:15359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.616461:0:15359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.616500:0:15359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790779129.616505:0:15359:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790779129.616531:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790779129.616535:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790779129.616541:0:15359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790779129.616547:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9b77342ff000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1790779129.616569:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790779129.616571:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790779129.616574:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790779129.616935:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779129.616944:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779129.616952:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742148800 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790779129.616956:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779129.616964:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790779129.616984:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779129.616989:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790779129.616992:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790779129.616994:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790779129.617038:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779129.617045:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790779129.617079:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779129.617086:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7742148800/0xb1aa4014e936cbb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779129.617101:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779129.617103:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779129.617105:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779129.617115:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779129.617134:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663812992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779129.617207:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779129.617277:0:6509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663812992 00000100:00100000:0.0:1790779129.617284:0:6509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663812992 00000100:00100000:0.0:1790779129.617324:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790779129.617332:0:6509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1877767663812992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790779129.617339:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790779129 with bad export cookie 12802115349310260869 00010000:00010000:3.0:1790779129.622841:0:15359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.622858:0:15359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.622866:0:15359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.622875:0:15359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.622933:0:15359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779129.622940:0:15359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.622948:0:15359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.622955:0:15359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.622962:0:15359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.622973:0:15359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790779129.622980:0:15359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.623005:0:15359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.623011:0:15359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.623018:0:15359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.623034:0:15359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1790779129.623040:0:15359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936c788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.623047:0:15359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936c788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.623053:0:15359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936c788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.623060:0:15359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936c788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.623066:0:15359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1790779129.623069:0:15359:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1790779129.623097:0:15359:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1790779129.623101:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1790779129.623105:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779129.623111:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1790779129.623118:0:15359:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9b773b4b5800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790779129.623129:0:15359:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9b7601de9000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790779129.623134:0:15359:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9b77340fb380) has exports, disconnecting them 00000020:00080000:3.0:1790779129.623138:0:15359:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9b773b4b5800), last request at 1790779125 00000020:00000080:3.0:1790779129.623145:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936ca67 00000100:00080000:3.0:1790779129.623164:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9b7601e13000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790779129.623213:0:15359:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b773b4b5800): rc 0 00000020:00000080:3.0:1790779129.623216:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b773b4b5800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1790779129.623227:0:15359:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9b7601de9000), last request at 1790779125 00000020:00000080:3.0:1790779129.623231:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c941 00000100:00080000:3.0:1790779129.623236:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9b7601dea000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1790779129.623247:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b4b5800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1790779129.623293:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7601e13000 for lustre-MDT0001 00000020:00080000:3.0:1790779129.623305:0:15359:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b7601de9000): rc 0 00000020:00000080:3.0:1790779129.623307:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b7601de9000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1790779129.623317:0:15359:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbc92c1ca7ae0 00000020:00000080:3.0:1790779129.623328:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7601de9000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1790779129.623348:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7601dea000 for lustre-MDT0001 00000100:00080000:3.0:1790779129.623367:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790779129.623377:0:15359:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9b773f4f6d80 x1877767663811072/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790779139 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779129.623391:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1790779129.624241:0:15359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790779129.624251:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9b7734596800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1790779129.624317:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790779129.624327:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624357:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cfe00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779129.624361:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624372:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779129.624380:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779129.624385:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790779129.624387:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1790779129.624390:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1790779129.624433:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624439:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779129.624458:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624466:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77055cfe00/0xb1aa4014e936cbc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936cbcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624480:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790779129.624483:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624489:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e7c00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779129.624492:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624506:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779129.624513:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779129.624518:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1790779129.624520:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1790779129.624522:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790779129.624537:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624543:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779129.624550:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624557:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77089e7c00/0xb1aa4014e936ca9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936caa6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624571:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779129.624574:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624580:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77089e6400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779129.624583:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624589:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779129.624607:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779129.624612:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790779129.624614:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790779129.624616:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790779129.624631:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624636:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779129.624651:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624657:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77089e6400/0xb1aa4014e936ce3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936ce42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624667:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779129.624671:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936c788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624677:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894aa00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779129.624679:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936c788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624686:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936c788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779129.624691:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936c788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779129.624706:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790779129.624708:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1790779129.624710:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1790779129.624724:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936c788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624730:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779129.624736:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936c788 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624742:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936c788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936c78f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779129.624757:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779129.624759:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779129.624761:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779129.624798:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663813120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779129.625715:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779129.625727:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779129.625744:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663813248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779129.625965:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779129.626029:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663813504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779129.626051:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779129.626070:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779129.626075:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663813376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779129.626093:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779129.626116:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663813248 00000100:00100000:1.0:1790779129.626123:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663813248 00000100:00100000:1.0:1790779129.626146:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663813504 00000100:00100000:1.0:1790779129.626148:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663813504 00000100:00100000:1.0:1790779129.626154:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663813376 00000100:00100000:1.0:1790779129.626156:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663813376 00000100:00100000:1.0:1790779129.626166:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790779129.626173:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772ff63850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1877767663813248:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790779129.626179:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790779129 with bad export cookie 12802115349310260869 00000100:00100000:1.0:1790779129.626224:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772ff63850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1877767663813248:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (260us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790779129.626231:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790779129.626247:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790779129.626250:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1877767663813504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790779129.626253:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790779129 with bad export cookie 12802115349310260869 00000100:00100000:1.0:1790779129.626273:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1877767663813504:12345-0@lo:103:ldlm_bl.0 Request processed in 22us (222us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790779129.626291:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790779129.626303:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790779129.626308:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1877767663813376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790779129.626312:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790779129 with bad export cookie 12802115349310260869 00000100:00100000:1.0:1790779129.626336:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1877767663813376:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (242us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790779129.626341:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1790779129.626444:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790779129.626448:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9b7711492800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1790779129.626451:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1790779129.626701:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779129.626743:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663811072:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1790779129.628186:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790779129.628195:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1790779129.628220:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790779129.628285:0:15359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790779129.628314:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9b77182bc000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1790779129.628331:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790779129.628333:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1790779129.628346:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790779129.628404:0:15359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1790779129.628427:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9b7603886000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1790779129.628453:0:15359:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9b77340fb380) has no exports 00000100:00100000:2.0:1790779129.628977:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663813632:0@lo:9:umount.0 00000100:00100000:2.0:1790779129.629054:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779129.629086:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663813760:0@lo:9:umount.0 00000100:00100000:2.0:1790779129.629110:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779129.629146:0:7465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663813120 00000100:00100000:2.0:1790779129.629154:0:7465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663813120 00000100:00100000:2.0:1790779129.629200:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790779129.629207:0:7465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3651:x1877767663813120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790779129.629214:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790779129 with bad export cookie 12802115349310260869 00000100:00100000:2.0:1790779129.629267:0:7465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3651:x1877767663813120:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (2565us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790779129.629273:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1790779129.629993:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790779129.630116:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1790779129.631053:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663813632 00000100:00100000:0.0:1790779129.631076:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663813632 00000100:00100000:0.0:1790779129.631136:0:8855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663813760 00000100:00100000:0.0:1790779129.631140:0:8855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663813760 00000100:00100000:0.0:1790779129.631163:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790779129.631171:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1877767663813632:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790779129.631198:0:8855:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c99c 00000100:00080000:0.0:1790779129.631207:0:8855:0:(import.c:65:import_set_state_nolock()) ffff9b7601dcf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790779129.631268:0:8855:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1790779129.631447:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3648:x1877767663813632:12345-0@lo:9:umount.0 Request processed in 276us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779129.631455:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790779129.631470:0:8855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790779129.631475:0:8855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1877767663813760:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790779129.631487:0:8855:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cad0 00000100:00080000:0.0:1790779129.631492:0:8855:0:(import.c:65:import_set_state_nolock()) ffff9b7603887800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790779129.631511:0:8855:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1790779129.631579:0:8855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3648:x1877767663813760:12345-0@lo:9:umount.0 Request processed in 103us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779129.631585:0:8855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1790779129.631619:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790779129.631623:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790779129.631635:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790779129.631669:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77182bc000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1790779129.631683:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790779129.631685:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790779129.631689:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663813632:0@lo:9:umount.0 00000100:00080000:0.0:1790779129.631701:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7603886000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1790779129.631710:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790779129.631719:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790779129.631723:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663813760:0@lo:9:umount.0 00010000:00010000:0.0:1790779129.631762:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779129.637625:0:6509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1877767663812992:12345-0@lo:103:ldlm_bl.0 Request processed in 20280us (20406us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790779129.637646:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790779129.637737:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790779129.644952:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.103@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1790779129.644958:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790779129.644968:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b773f4f4e00 x1877767663811584/t0(0) o400->MGC192.168.203.103@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790779141 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779129.644984:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b76046cc700 x1877767663812992/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790779145 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779129.644993:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b773b7a8a80 x1877767663813120/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790779145 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779129.645002:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b773b7aaa00 x1877767663813248/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790779145 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779129.645011:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b773b7a8e00 x1877767663813504/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790779145 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779129.645021:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b773b7aa680 x1877767663813376/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790779145 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790779129.645030:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790779129.645033:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790779129.645056:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1790779129.645257:0:3652:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9b7711492800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1790779129.645282:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3110940-f102-4234-a689-7d64ccf7427e:3652:1877767663813248:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790779129.645384:0:3651:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9b7711492800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1790779129.645405:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663811584:0@lo:400:kworker.0 00000100:00100000:3.0:1790779129.645421:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3110940-f102-4234-a689-7d64ccf7427e:3651:1877767663813120:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1790779129.645722:0:3649:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9b7711492800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1790779129.645736:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3110940-f102-4234-a689-7d64ccf7427e:3649:1877767663812992:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1790779129.646017:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9b7711492800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779129.646024:0:3650:0:(import.c:545:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 189 00000100:00080000:1.0:1790779129.646041:0:3650:0:(import.c:666:import_select_connection()) MGC192.168.203.103@tcp: import ffff9b7711492800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779129.646084:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603bd1180 x1877767663813888/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779129.646119:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663813504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779129.646134:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3110940-f102-4234-a689-7d64ccf7427e:3650:1877767663813376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779129.646161:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3110940-f102-4234-a689-7d64ccf7427e:3648:1877767663813888:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1790779129.646210:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877767663813888 offset 0 length 520: 4 00000020:00080000:0.0:1790779129.654313:0:15359:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9b77340fb380) has no exports 00000020:01000000:1.0:1790779129.703545:0:15359:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b76032818a0 - data ffff9b770e12fbd0/ffff9b76035db000 00000020:01000000:1.0:1790779129.703744:0:15359:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b7711bd8d20 - data ffff9b770e22b0d8/ffff9b77343f8c00 00000001:00000004:1.0:1790779129.719063:0:15359:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1790779129.774480:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790779129.774490:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1790779129.774499:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1790779129.777458:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790779129.777467:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1790779129.777485:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790779129.777487:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790779129.778278:0:8843:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790779129.778283:0:8843:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1790779129.778311:0:8843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1790779129.779649:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790779129.779726:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1790779129.779781:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790779129.779783:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790779129.780681:0:10054:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790779129.780687:0:10054:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1790779129.780698:0:10054:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1790779129.787610:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c7ab 00000020:00000080:0.0:1790779129.787624:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b7734592000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790779129.788320:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7734592000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790779129.793685:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c7c0 00000020:00000080:0.0:1790779129.793701:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b7734596000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790779129.793721:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1790779129.793726:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790779129.793735:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790779129.793740:0:15359:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9b77340f99c0) has no exports 00000020:00000080:3.0:1790779129.793743:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7734596000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1790779129.794266:0:15359:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790779129.794276:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cac9 00000020:00000080:3.0:1790779129.794282:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b760322f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790779129.794296:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1790779129.794301:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779129.794308:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790779129.794310:0:15359:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff9b773409cd40) has no exports 00000020:00000080:3.0:1790779129.794316:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936cac2 00000020:00000080:3.0:1790779129.794319:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b7601dc8800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1790779129.794692:0:15359:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1790779129.794697:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790779129.794701:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1790779129.794706:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779129.794709:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790779129.794738:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779129.794758:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790779129.794764:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c987 00000020:00000080:3.0:1790779129.794769:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b773b6d4800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790779129.794772:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1790779129.794776:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779129.794779:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790779129.794782:0:15359:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9b7735a6b380) has no exports 00000020:00000080:3.0:1790779129.794785:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c980 00000020:00000080:3.0:1790779129.794787:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b773424f800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1790779129.795343:0:15359:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1790779129.795348:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790779129.795350:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1790779129.795353:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779129.795355:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790779129.795376:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779129.795382:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1790779129.795392:0:15359:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1790779129.795397:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c7e3 00000020:00000080:3.0:1790779129.795402:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b7734592800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790779129.795407:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1790779129.795411:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779129.795414:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790779129.795416:0:15359:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9b7735a68000) has no exports 00000020:00000080:3.0:1790779129.795419:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c7dc 00000020:00000080:3.0:1790779129.795422:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b7734595000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790779129.796226:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760322f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1790779129.796255:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7601dc8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790779129.796261:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7603886000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1790779129.796268:0:36:0:(genops.c:885:class_export_put()) final put ffff9b773b6d3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790779129.796270:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1790779129.796274:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790779129.796357:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1790779129.796362:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773424f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790779129.796366:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b77182bc000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1790779129.796369:0:36:0:(genops.c:885:class_export_put()) final put ffff9b7704180800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790779129.796371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704180800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1790779129.796374:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790779129.796400:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7734592800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790779129.796404:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7734595000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1790779129.797301:0:15359:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1790779129.797307:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790779129.797311:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1790779129.797318:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790779129.797363:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790779129.797374:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790779129.797398:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790779129.797401:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790779129.797405:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b770411f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790779129.797409:0:15359:0:(genops.c:844:class_export_destroy()) destroying export ffff9b770411f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1790779129.797414:0:15359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790779129.797581:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c7c7 00000020:00000080:0.0:1790779129.797591:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b7734597000/lustre-MDD0001_UUID 00000020:01000000:0.0:1790779129.797596:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1790779129.797600:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790779129.797612:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790779129.797616:0:15359:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9b77340fcd40) has no exports 00000020:00000080:0.0:1790779129.797634:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790779129.797636:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1790779129.797640:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c7ce 00000020:00000080:0.0:1790779129.797645:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b7734595800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1790779129.797652:0:15359:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b7712708000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1790779129.797655:0:15359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b7712708000 2 00000020:01000004:0.0:1790779129.797658:0:15359:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b7712708000 from lustre-MDT0001 00000020:00000080:0.0:1790779129.797683:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790779129.797687:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1790779129.797689:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b7734591000/lustre-MDT0001_UUID 00000020:00000080:0.0:1790779129.797691:0:15359:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7734591000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1790779129.797697:0:15359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1790779129.797726:0:15359:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1790779129.797729:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1790779129.797737:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790779129.797741:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790779129.797747:0:15359:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9b770411d000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790779129.797752:0:15359:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9b7741168000) has exports, disconnecting them 00000020:00080000:0.0:1790779129.797757:0:15359:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9b770411d000), last request at 1790778892 00000020:00000080:0.0:1790779129.797761:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c822 00000020:00080000:0.0:1790779129.797774:0:15359:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b770411d000): rc 0 00000020:00000080:0.0:1790779129.797777:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b770411d000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1790779129.799016:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7734596800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1790779129.799028:0:36:0:(genops.c:885:class_export_put()) final put ffff9b7734594800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790779129.799030:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7734594800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1790779129.799043:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790779129.799167:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7734597000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1790779129.799171:0:36:0:(genops.c:885:class_export_put()) final put ffff9b7734593800/lustre-MDD0001_UUID 00000020:00000080:1.0:1790779129.799172:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7734593800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1790779129.799177:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1790779129.799467:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7734595800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790779129.799473:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b770411d000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1790779129.799507:0:15359:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1790779129.799517:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790779129.799531:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790779129.799537:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790779129.799560:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b77342ff000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1790779129.799700:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779129.799708:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1790779129.799711:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b77342fc800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1790779129.799714:0:15359:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77342fc800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1790779129.799717:0:15359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1790779129.799747:0:15359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b7712708000 1 00000020:00000080:1.0:1790779129.799752:0:15359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c75e 00000020:00000080:1.0:1790779129.799758:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b773424b000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1790779129.799766:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1790779129.799773:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773424b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790779129.799782:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779129.799786:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790779129.799789:0:15359:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9b77041c99c0) has no exports 00010000:00010000:1.0:1790779129.959972:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790779130.030676:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779130.030693:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1790779130.030698:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b771270f000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790779130.030703:0:15359:0:(genops.c:844:class_export_destroy()) destroying export ffff9b771270f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1790779130.030714:0:15359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1790779130.030858:0:15359:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b771270d000 00000020:01000000:3.0:1790779130.030941:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1790779130.030958:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779130.030964:0:15359:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790779130.030968:0:15359:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9b774116cd40) has no exports 00000100:00100000:3.0:1790779130.031078:0:6524:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff9b771dbca800:6524] 1 exiting: rc = 0 00000100:00100000:3.0:1790779130.031199:0:10428:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff9b7603726800:10428] 3 exiting: rc = 0 00000100:00100000:3.0:1790779130.031274:0:6525:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff9b771da47e00:6525] 2 exiting: rc = 0 00000100:00100000:2.0:1790779130.031475:0:6523:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff9b771dbcbc00:6523] 0 exiting: rc = 1 00000100:00100000:0.0:1790779130.031693:0:13003:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff9b773b78dc00:13003] 4 exiting: rc = 0 00000100:00100000:0.0:1790779130.031764:0:13821:0:(service.c:3206:ptlrpc_main()) mdt00_005: service thread [ffff9b7735f95a00:13821] 5 exiting: rc = 0 00000100:00100000:3.0:1790779130.033580:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033591:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033597:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033602:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033608:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033613:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033619:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033625:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033630:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033636:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033641:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033646:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033788:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033796:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033802:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033807:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033812:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033817:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033822:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033828:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033842:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033848:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033853:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033860:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033865:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033872:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033906:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033913:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033918:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033935:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033940:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033946:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033965:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033971:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033977:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033982:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033988:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033993:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.033998:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034003:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034008:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034014:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034019:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034024:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034029:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034034:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034039:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034044:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034050:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034055:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034061:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034065:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034071:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034076:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034081:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034086:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034092:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034097:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034102:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034465:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034475:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034480:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034485:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.034491:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779130.037617:0:6527:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b770753ae00:6527] 1 exiting: rc = 0 00000100:00100000:1.0:1790779130.038047:0:6526:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b770753b600:6526] 0 exiting: rc = 1 00000100:00100000:3.0:1790779130.038174:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038182:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038189:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038195:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038201:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038207:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038213:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038219:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038224:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038230:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038236:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038243:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038250:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038255:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038259:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038264:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038269:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038274:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038279:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038284:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038289:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038293:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038298:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038304:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038309:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038314:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038320:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038325:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038330:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038335:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038340:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038345:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038350:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038355:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038360:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038382:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038387:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038392:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038397:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038402:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038406:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038412:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038416:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038420:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038425:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038431:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038436:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038439:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038444:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038449:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038455:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038459:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038464:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038468:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038474:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038479:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038484:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038489:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038494:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038499:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038504:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038509:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038514:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.038520:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779130.043531:0:6529:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff9b77305a4600:6529] 1 exiting: rc = 0 00000100:00100000:3.0:1790779130.044032:0:6528:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff9b771847fc00:6528] 0 exiting: rc = 1 00000100:00100000:1.0:1790779130.044286:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044298:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044307:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044314:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044320:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044329:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044334:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044340:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044347:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044370:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044378:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044384:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044390:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044397:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044417:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044425:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044432:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044438:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044443:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044450:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044457:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044479:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044486:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044492:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044498:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044505:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044511:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044517:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044523:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044529:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044536:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044542:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044548:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044567:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044574:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044579:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044586:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044593:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044599:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044605:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044612:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044618:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044625:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044630:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044636:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044733:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044743:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044750:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044756:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044771:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044778:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044784:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044790:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044797:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044804:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044810:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044816:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044850:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044858:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044865:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044871:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044982:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.044990:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.045004:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779130.062495:0:6530:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b77305a5200:6530] 0 exiting: rc = 1 00000100:00100000:3.0:1790779130.062638:0:6531:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b77305a4200:6531] 1 exiting: rc = 0 00000100:00100000:1.0:1790779130.062821:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.062845:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.062852:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.062858:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.062862:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.062868:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.062873:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063072:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063083:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063090:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063098:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063104:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063110:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063115:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063120:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063124:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063129:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063134:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063138:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063143:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063162:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063166:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063171:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063175:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063180:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063185:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063189:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063194:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063199:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063203:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063207:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063212:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063216:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063221:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063227:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063243:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063249:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063254:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063258:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063263:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063267:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063272:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063278:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063284:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063288:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063293:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063298:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063303:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063308:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063313:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063317:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063323:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063329:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063333:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063338:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063352:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063358:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063363:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063368:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063372:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063377:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063382:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063388:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.063393:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779130.066751:0:6533:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b7703a56800:6533] 1 exiting: rc = 0 00000100:00100000:1.0:1790779130.068364:0:6532:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b7703a57a00:6532] 0 exiting: rc = 1 00000100:00100000:1.0:1790779130.068748:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068755:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068760:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068764:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068769:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068775:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068780:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068786:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068792:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068797:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068803:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068808:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068814:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068820:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068825:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068841:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068847:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068852:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068857:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068862:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068867:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068871:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.068876:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069070:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069075:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069094:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069099:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069105:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069124:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069129:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069134:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069140:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069146:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069151:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069157:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069163:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069168:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069174:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069179:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069185:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069191:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069197:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069202:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069208:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069213:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069218:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069223:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069229:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069409:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069415:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069420:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069424:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069429:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069433:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069438:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069442:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069446:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069451:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069456:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069459:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069472:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069476:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069481:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.069486:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779130.070270:0:6534:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b7703a57400:6534] 0 exiting: rc = 1 00000100:00100000:2.0:1790779130.070452:0:6535:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b7703a57600:6535] 1 exiting: rc = 0 00000100:00100000:1.0:1790779130.070551:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070557:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070563:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070568:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070573:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070577:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070583:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070588:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070593:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070598:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070604:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070609:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070615:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070619:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070624:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070629:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070634:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070638:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070643:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070648:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070719:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070724:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070728:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070733:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070738:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070743:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070747:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070752:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070756:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070760:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070765:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070780:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070785:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070789:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070794:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070798:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070802:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070807:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070812:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070816:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070821:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070827:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070843:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070849:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070854:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070858:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070863:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070868:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070873:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070910:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070917:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070922:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070926:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070931:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070936:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070941:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070945:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070950:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070955:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070959:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070963:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070967:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070972:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.070976:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779130.071943:0:6537:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff9b771d8fb800:6537] 1 exiting: rc = 0 00000100:00100000:1.0:1790779130.072455:0:6538:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff9b771d8fb200:6538] 2 exiting: rc = 0 00000100:00100000:0.0:1790779130.072758:0:6536:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff9b771d8faa00:6536] 0 exiting: rc = 1 00000100:00100000:1.0:1790779130.072905:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072923:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072928:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072935:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072940:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072946:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072952:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072958:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072965:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072971:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072977:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072983:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072989:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072994:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.072999:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073004:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073009:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073031:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073037:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073042:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073048:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073053:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073058:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073064:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073069:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073075:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073086:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073091:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073096:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073102:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073298:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073309:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073315:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073321:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073326:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073331:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073343:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073348:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073353:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073358:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073362:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073378:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073384:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073389:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073395:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073400:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073406:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073411:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073417:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073423:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073429:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073435:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073441:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073446:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073452:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073458:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073463:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073468:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073474:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073480:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073485:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073491:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073497:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779130.073503:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790779130.082860:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779130.082873:0:15359:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1790779130.083069:0:15359:0:(genops.c:885:class_export_put()) final put ffff9b77182bd000/MDS_uuid 00000020:00000080:2.0:1790779130.083074:0:15359:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77182bd000/MDS_uuid for MDS 00000020:01000000:2.0:1790779130.083080:0:15359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1790779130.083363:0:15359:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1790779130.984017:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790779130.985935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3110940-f102-4234-a689-7d64ccf7427e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779130.985944:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d3110940-f102-4234-a689-7d64ccf7427e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779130.985947:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779130.985951:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790779130.985955:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7601dee800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779130.985964:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1790779130.985971:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790779130.985985:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b7601dee800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779130.986255:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b760300b800 x1877767663814016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779130.986318:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779130.986322:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790779130.986324:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7601e10800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779130.986328:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1790779130.986331:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790779130.986336:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b7601e10800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779130.986352:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603009180 x1877767663814272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779130.986392:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663814400:0@lo:400:kworker.0 00000400:00000100:2.0:1790779130.986453:0:3652:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663814400 offset 0 length 224: 4 00000100:00100000:0.0:1790779130.986602:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663814144:0@lo:400:kworker.0 00000400:00000100:0.0:1790779130.986630:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663814144 offset 0 length 224: 4 00000100:00100000:1.0:1790779130.986707:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663814016:0@lo:38:kworker.0 00000400:00000100:1.0:1790779130.986731:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663814016 offset 0 length 520: 4 00000100:00100000:1.0:1790779130.989672:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663814272:0@lo:38:kworker.0 00000400:00000100:1.0:1790779130.989730:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663814272 offset 0 length 520: 4 00010000:00010000:3.0:1790779132.019194:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779133.033904:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779134.056626:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790779134.586839:0:15560:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790779134.601645:0:15560:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1790779134.601723:0:15560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779134.601739:0:15560:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779134.601747:0:15560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779134.601754:0:15560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779134.601788:0:15560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790779134.601793:0:15560:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790779134.601830:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790779134.601842:0:15560:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b760300b800 x1877767663814016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779145 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779134.601857:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790779134.601863:0:15560:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790779134.601869:0:15560:0:(import.c:65:import_set_state_nolock()) ffff9b7601dee800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790779134.601874:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790779134.601900:0:15560:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b760300b800 x1877767663814016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779145 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779134.601908:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790779134.601924:0:15560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:2.0:1790779134.602031:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779134.602038:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779134.602047:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2e00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779134.602051:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779134.602060:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779134.602067:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779134.602073:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790779134.602082:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790779134.602084:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790779134.602096:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b7711492800 00010000:00010000:2.0:1790779134.602100:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779134.602106:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76039a2e00/0xb1aa4014e936cb9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936cba2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779134.602117:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779134.602119:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779134.602120:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779134.602359:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663814016:0@lo:38:kworker.0 00000100:00080000:0.0:1790779134.603422:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790779134.603433:0:15560:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7603009500 x1877767663814144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779146 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779134.603457:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790779134.603462:0:15560:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790779134.603486:0:15560:0:(import.c:65:import_set_state_nolock()) ffff9b77342fd800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790779134.603579:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1877767663814528:0@lo:39:umount.0 00000400:00000100:2.0:1790779134.603629:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663814528 offset 0 length 224: 4 00000100:00100000:1.0:1790779134.603919:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663814144:0@lo:400:kworker.0 00000100:00080000:2.0:1790779135.016024:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3110940-f102-4234-a689-7d64ccf7427e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779135.016034:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d3110940-f102-4234-a689-7d64ccf7427e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779135.016037:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779135.016040:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790779135.016159:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779135.016188:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663814656:0@lo:400:kworker.0 00000400:00000100:1.0:1790779135.016241:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663814656 offset 0 length 224: 4 00010000:00010000:1.0:1790779135.084637:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790779135.085022:0:8432:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790779135.085028:0:8432:0:(genops.c:885:class_export_put()) final put ffff9b7601dc9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790779135.085198:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7601dc9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1790779135.085254:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7601dcf000 for lustre-OST0000 00000001:00100000:3.0:1790779135.088691:0:9517:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790779135.088701:0:9517:0:(genops.c:885:class_export_put()) final put ffff9b7603882800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790779135.088806:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603882800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790779135.088903:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7603887800 for lustre-OST0001 00010000:00010000:0.0:1790779136.104145:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779137.128395:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779138.152124:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779139.176101:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779139.752031:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779129/real 1790779129] req@ffff9b7603bd1180 x1877767663813888/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790779139 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779139.752076:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603bd1180 x1877767663813888/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790779139 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790779139.752279:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7711492800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779139.752333:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1790779139.752338:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3110940-f102-4234-a689-7d64ccf7427e:3648:1877767663813888:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1790779139.752550:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3110940-f102-4234-a689-7d64ccf7427e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790779139.752557:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1790779139.752561:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b7711492800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779139.752566:0:38:0:(import.c:545:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1790779139.752572:0:38:0:(import.c:630:import_select_connection()) MGC192.168.203.103@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790779139.752586:0:38:0:(import.c:666:import_select_connection()) MGC192.168.203.103@tcp: import ffff9b7711492800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779139.752624:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b76046cdf80 x1877767663814784/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790779139.752654:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790779139.752659:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790779139.752738:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663814912:0@lo:400:kworker.0 00000400:00000100:1.0:1790779139.752811:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663814912 offset 0 length 224: 4 00000100:00100000:2.0:1790779139.753005:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3110940-f102-4234-a689-7d64ccf7427e:3648:1877767663814784:0@lo:250:kworker.0 00000400:00000100:2.0:1790779139.753034:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877767663814784 offset 0 length 520: 4 00010000:00010000:2.0:1790779140.202903:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779141.225437:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779142.248032:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779143.273894:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779144.296694:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790779144.808783:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3110940-f102-4234-a689-7d64ccf7427e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790779144.808794:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d3110940-f102-4234-a689-7d64ccf7427e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779144.808798:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790779144.808801:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790779144.808923:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663815040:0@lo:400:kworker.0 00000400:00000100:1.0:1790779144.808979:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663815040 offset 0 length 224: 4 00000100:00100000:2.0:1790779144.872060:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779134/real 1790779134] req@ffff9b76046cc700 x1877767663814528/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790779144 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779144.872094:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b76046cc700 x1877767663814528/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790779144 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790779144.872115:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77342fd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790779144.872134:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1877767663814528:0@lo:39:umount.0 00000100:00080000:0.0:1790779144.875019:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790779144.875027:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790779144.875033:0:15560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790779144.879274:0:15560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779144.879293:0:15560:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779144.879300:0:15560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779144.879306:0:15560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779144.880995:0:15560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790779144.881016:0:15560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779144.881028:0:15560:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779144.881035:0:15560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779144.881042:0:15560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779144.883616:0:15560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790779144.883630:0:15560:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1790779144.883700:0:15560:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1790779144.883705:0:15560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1790779144.883714:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790779144.883731:0:15560:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790779144.883748:0:15560:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9b773b780000) has no exports 00000020:00080000:0.0:1790779144.883774:0:15560:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9b773b780000) has no exports 00010000:00010000:2.0:1790779144.884373:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779144.884385:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779144.884393:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742148a00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779144.884397:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779144.884405:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779144.884411:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779144.884416:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790779144.884426:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1790779144.884429:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1790779144.884445:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b7711492800 00010000:00010000:2.0:1790779144.884448:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779144.884455:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7742148a00/0xb1aa4014e936cba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936cbb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779144.884468:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779144.884471:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779144.884476:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055ce200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779144.884479:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779144.884485:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779144.884489:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779144.884494:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790779144.884496:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790779144.884497:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790779144.884501:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b7711492800 00010000:00010000:2.0:1790779144.884504:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779144.884509:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77055ce200/0xb1aa4014e936ce2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936ce34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779144.884521:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779144.884523:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779144.884524:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790779144.890516:0:15560:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b76034f8ae0 - data ffff9b770e352e58/ffff9b76027e2800 00000020:01000000:0.0:1790779144.890679:0:15560:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b773426a000 - data ffff9b770e281e58/ffff9b7601ddbc00 00010000:00010000:1.0:1790779144.893197:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1790779144.906461:0:15560:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790779144.917525:0:15560:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c8fb 00000020:00000080:2.0:1790779144.917537:0:15560:0:(genops.c:885:class_export_put()) final put ffff9b7601e11000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790779144.917562:0:15560:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b77344a6000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790779144.917566:0:15560:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b77344a6000 2 00000020:01000004:2.0:1790779144.917570:0:15560:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b77344a6000 from lustre-OST0000 00000020:00000080:3.0:1790779144.917671:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7601e11000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1790779144.917736:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779144.917747:0:15560:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790779144.917750:0:15560:0:(genops.c:885:class_export_put()) final put ffff9b7601e16000/lustre-OST0000_UUID 00000020:00000080:2.0:1790779144.917753:0:15560:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7601e16000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790779144.917758:0:15560:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790779144.917823:0:15560:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790779144.917828:0:15560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790779144.917832:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779144.917847:0:15560:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790779144.917855:0:15560:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b773b4b1000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790779144.917861:0:15560:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9b77041ccd40) has exports, disconnecting them 00000020:00080000:2.0:1790779144.917866:0:15560:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b773b4b1000), last request at 1790778912 00000020:00000080:2.0:1790779144.917870:0:15560:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c925 00000020:00080000:2.0:1790779144.918311:0:15560:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b773b4b1000): rc 0 00000020:00000080:2.0:1790779144.918318:0:15560:0:(genops.c:885:class_export_put()) final put ffff9b773b4b1000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790779144.920983:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b4b1000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1790779144.921037:0:15560:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1790779144.921042:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790779144.921047:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790779144.921053:0:15560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790779144.921079:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7601dee800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790779144.921390:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779144.921399:0:15560:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1790779144.921404:0:15560:0:(genops.c:885:class_export_put()) final put ffff9b7601ded000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1790779144.921407:0:15560:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7601ded000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1790779144.921412:0:15560:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1790779144.921484:0:15560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1790779144.921488:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779144.921493:0:15560:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790779144.921500:0:15560:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9b773b4b0800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790779144.921507:0:15560:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff9b7735a699c0) has exports, disconnecting them 00000020:00080000:3.0:1790779144.921511:0:15560:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9b773b4b0800), last request at 1790778912 00000020:00000080:3.0:1790779144.921515:0:15560:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c93a 00000020:00080000:3.0:1790779144.921529:0:15560:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b773b4b0800): rc 0 00000020:00000080:3.0:1790779144.921544:0:15560:0:(genops.c:885:class_export_put()) final put ffff9b773b4b0800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790779144.922627:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b4b0800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1790779144.926999:0:15560:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790779144.927008:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790779144.927013:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790779144.927021:0:15560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790779144.927052:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b77342fd800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790779144.927236:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779144.927245:0:15560:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1790779144.927250:0:15560:0:(genops.c:885:class_export_put()) final put ffff9b773b4b5000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1790779144.927254:0:15560:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b4b5000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1790779144.927260:0:15560:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1790779144.927324:0:15560:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b77344a6000 1 00000020:00000080:1.0:1790779144.927339:0:15560:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c8c3 00000020:00000080:1.0:1790779144.927345:0:15560:0:(genops.c:885:class_export_put()) final put ffff9b7704119000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1790779144.927354:0:15560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1790779144.927362:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704119000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790779144.927372:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779144.927378:0:15560:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790779144.927381:0:15560:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9b773b784d40) has no exports 00000020:00000080:1.0:1790779145.081606:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779145.081620:0:15560:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1790779145.081625:0:15560:0:(genops.c:885:class_export_put()) final put ffff9b77344a2000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790779145.081629:0:15560:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77344a2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1790779145.081640:0:15560:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1790779145.091282:0:15560:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b77344a1000 00000020:02000400:1.0:1790779145.091343:0:15560:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1790779145.321036:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779145.896057:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779130/real 1790779130] req@ffff9b7603009180 x1877767663814272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790779145 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779145.896090:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603009180 x1877767663814272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790779145 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790779145.896148:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7601e10800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779145.896177:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790779145.896181:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663814272:0@lo:38:kworker.0 00000100:00080000:0.0:1790779145.896318:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3110940-f102-4234-a689-7d64ccf7427e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790779145.896325:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d3110940-f102-4234-a689-7d64ccf7427e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790779145.896327:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790779145.896329:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790779145.896332:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7601e10800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779145.896337:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 448 00000100:00080000:0.0:1790779145.896343:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790779145.896355:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b7601e10800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779145.896585:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b76046cf100 x1877767663815168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790779145.896652:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663815296:0@lo:400:kworker.0 00000400:00000100:0.0:1790779145.896721:0:3652:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663815296 offset 0 length 224: 4 00000100:00100000:2.0:1790779145.897031:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663815168:0@lo:38:kworker.0 00000400:00000100:2.0:1790779145.897055:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663815168 offset 0 length 520: 4 00010000:00010000:1.0:1790779146.347505:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1790779146.926691:0:3652:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779130/real 1790779130] req@ffff9b760300bb80 x1877767663814400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790779146 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779146.973171:0:3652:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9b760300bb80 x1877767663814400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790779146 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790779146.973187:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9b773f472000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790779146.973191:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790779146.992326:0:3652:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1790779146.993012:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663814400:0@lo:400:kworker.0 00000100:00080000:2.0:1790779146.993396:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3110940-f102-4234-a689-7d64ccf7427e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779146.993402:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d3110940-f102-4234-a689-7d64ccf7427e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779146.993406:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779146.993409:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779146.993412:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779146.993415:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790779146.993418:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b773f472000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779146.993424:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 250 00000100:00080000:2.0:1790779146.993437:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b773f472000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779146.993471:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603009180 x1877767663815424/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779146.993513:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1877767663815424:0@lo:38:kworker.0 00000400:00000100:2.0:1790779146.993559:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663815424 offset 0 length 520: 4 00010000:00010000:2.0:1790779147.368107:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779148.396133:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790779148.774624:0:15762:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790779148.790034:0:15762:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1790779148.790140:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779148.790153:0:15762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779148.790160:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779148.790167:0:15762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779148.790192:0:15762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790779148.790197:0:15762:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790779148.790225:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790779148.790235:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b76046cf100 x1877767663815168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779165 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779148.790250:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790779148.790279:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7601e10800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790779148.790284:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1790779148.790289:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663815168:0@lo:38:kworker.0 00000100:00080000:3.0:1790779148.790314:0:15762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790779148.790318:0:15762:0:(import.c:65:import_set_state_nolock()) ffff9b7601e10800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1790779148.790323:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790779148.790325:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790779148.790328:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790779148.791281:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779148.791293:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.791320:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cf200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779148.791324:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.791333:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779148.791339:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779148.791345:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790779148.791347:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790779148.791350:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790779148.791366:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b7711492800 00010000:00010000:2.0:1790779148.791369:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.791375:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77055cf200/0xb1aa4014e936cb7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936cb86 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.791388:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779148.791389:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779148.791391:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790779148.793076:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790779148.793093:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b760300b480 x1877767663814656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779151 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779148.794778:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b76046ce300 x1877767663814912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779155 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779148.794794:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b773f4f5f80 x1877767663815040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779160 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779148.794808:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b76046ced80 x1877767663815296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779161 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779148.794823:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7603009180 x1877767663815424/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779156 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779148.794835:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790779148.794875:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773f472000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790779148.794896:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1790779148.794901:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1877767663815424:0@lo:38:kworker.0 00000100:00080000:3.0:1790779148.794931:0:15762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790779148.794937:0:15762:0:(import.c:65:import_set_state_nolock()) ffff9b773f472000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1790779148.794944:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790779148.794950:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b760300b480 x1877767663814656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779151 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779148.795013:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663815040:0@lo:400:kworker.0 00000100:00100000:2.0:1790779148.795079:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663814656:0@lo:400:kworker.0 00000100:00100000:3.0:1790779148.795098:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b76046ce300 x1877767663814912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779155 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779148.795107:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b773f4f5f80 x1877767663815040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779160 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779148.795114:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b76046ced80 x1877767663815296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779161 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779148.795139:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790779148.795517:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663815296:0@lo:400:kworker.0 00000100:00100000:2.0:1790779148.800531:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663814912:0@lo:400:kworker.0 00000100:00100000:3.0:1790779148.800593:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790779148.802596:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779148.802614:0:15762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779148.802622:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779148.802629:0:15762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779148.802709:0:15762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779148.802718:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779148.802724:0:15762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779148.802729:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779148.802735:0:15762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.802846:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779148.802855:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.802875:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742148200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779148.802909:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.802919:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779148.802926:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779148.802931:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790779148.802934:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1790779148.802944:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b7711492800 00010000:00010000:2.0:1790779148.802947:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.802954:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7742148200/0xb1aa4014e936cb8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936cb94 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.802970:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779148.802973:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.802979:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77055cf000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779148.802982:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.802988:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779148.803000:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779148.803005:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790779148.803007:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1790779148.803012:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b7711492800 00010000:00010000:2.0:1790779148.803016:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.803022:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779148.803024:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779148.803026:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779148.803148:0:15762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790779148.803153:0:15762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77055cf000/0xb1aa4014e936ce1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936ce26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779148.803174:0:15762:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1790779148.803180:0:15762:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1790779148.803192:0:15762:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1790779148.803223:0:15762:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1790779148.803228:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1790779148.803233:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779148.803239:0:15762:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790779148.803243:0:15762:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9b7603220000) has no exports 00000020:00080000:3.0:1790779148.803266:0:15762:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9b7603220000) has no exports 00000020:01000000:3.0:1790779148.804953:0:15762:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b76034f8cc0 - data ffff9b770e352d80/ffff9b76027e0800 00000020:01000000:3.0:1790779148.805118:0:15762:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b76036add20 - data ffff9b760201a0d8/ffff9b7603879000 00010000:00010000:0.0:1790779148.809055:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1790779148.819573:0:15762:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790779148.833983:0:15762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936ca21 00000020:00000080:2.0:1790779148.833998:0:15762:0:(genops.c:885:class_export_put()) final put ffff9b7603228800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1790779148.834025:0:15762:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b760310d000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1790779148.834029:0:15762:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b760310d000 2 00000020:01000004:2.0:1790779148.834032:0:15762:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b760310d000 from lustre-OST0001 00000020:00000080:2.0:1790779148.834065:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779148.834070:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603228800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790779148.834075:0:15762:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1790779148.834078:0:15762:0:(genops.c:885:class_export_put()) final put ffff9b773f476000/lustre-OST0001_UUID 00000020:00000080:2.0:1790779148.834080:0:15762:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773f476000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1790779148.834086:0:15762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1790779148.834207:0:15762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d3110940-f102-4234-a689-7d64ccf7427e->MGS 00010000:00010000:2.0:1790779148.834224:0:15762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894b000/0xb1aa4014e936c77a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936c781 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779148.834236:0:15762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b000/0xb1aa4014e936c77a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936c781 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779148.834242:0:15762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1790779148.834253:0:15762:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1790779148.834257:0:15762:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1790779148.834272:0:15762:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b7711492800 00010000:00010000:2.0:1790779148.834275:0:15762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894b000/0xb1aa4014e936c77a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936c781 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779148.834291:0:15762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936cbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936cbf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779148.834297:0:15762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936cbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936cbf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779148.834302:0:15762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790779148.834304:0:15762:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1790779148.834305:0:15762:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1790779148.834320:0:15762:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b7711492800 00010000:00010000:2.0:1790779148.834323:0:15762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b77089e6600/0xb1aa4014e936cbef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936cbf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790779148.834340:0:15762:0:(import.c:65:import_set_state_nolock()) ffff9b7711492800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1790779148.834345:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790779148.834347:0:15762:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790779148.834349:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1790779148.834354:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790779148.834365:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b76046cdf80 x1877767663814784/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790779154 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790779148.834389:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790779148.834392:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1790779148.834838:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3110940-f102-4234-a689-7d64ccf7427e:3648:1877767663814784:0@lo:250:kworker.0 10000000:01000000:2.0:1790779148.836119:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790779148.836135:0:15762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c677 00000020:00000080:2.0:1790779148.836144:0:15762:0:(genops.c:885:class_export_put()) final put ffff9b77182bb800/d3110940-f102-4234-a689-7d64ccf7427e 00000020:01000000:2.0:1790779148.836166:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.103@tcp (flags='') 00000020:00000080:2.0:1790779148.836181:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779148.836187:0:15762:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790779148.836192:0:15762:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9b773059cd40) has no exports 00000020:00000080:1.0:1790779148.836567:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77182bb800/d3110940-f102-4234-a689-7d64ccf7427e for MGC192.168.203.103@tcp 10000000:01000000:0.0:1790779148.836959:0:6520:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1790779148.838938:0:15762:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.103@tcp: client import never connected 00000100:00080000:2.0:1790779148.838948:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1790779148.838952:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790779148.838956:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1790779148.838959:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790779148.839023:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779148.839032:0:15762:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.103@tcp (uuid d3110940-f102-4234-a689-7d64ccf7427e) 00000020:01000000:2.0:1790779148.839041:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790779148.839048:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779148.839053:0:15762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790779148.839061:0:15762:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b773b648000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790779148.839069:0:15762:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff9b773b7819c0) has exports, disconnecting them 00000020:00080000:2.0:1790779148.839073:0:15762:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b773b648000), last request at 1790778932 00000020:00000080:2.0:1790779148.839078:0:15762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936ca4b 00000020:00080000:2.0:1790779148.839094:0:15762:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b773b648000): rc 0 00000020:00000080:2.0:1790779148.839100:0:15762:0:(genops.c:885:class_export_put()) final put ffff9b773b648000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1790779148.839123:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7711492800 for MGC192.168.203.103@tcp 00000020:00000080:1.0:1790779148.839132:0:38:0:(genops.c:885:class_export_put()) final put ffff9b7702b8a000/d3110940-f102-4234-a689-7d64ccf7427e 00000020:00000080:1.0:1790779148.839135:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7702b8a000/d3110940-f102-4234-a689-7d64ccf7427e for MGC192.168.203.103@tcp 00000020:01000000:1.0:1790779148.839154:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.103@tcp (d3110940-f102-4234-a689-7d64ccf7427e) 00000020:00000080:1.0:1790779148.839408:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b648000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790779148.842972:0:15762:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790779148.843000:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790779148.843004:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790779148.843011:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790779148.843208:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790779148.843217:0:15762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1790779148.843224:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790779148.843228:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790779148.843232:0:15762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790779148.843239:0:15762:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9b7704184000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790779148.843246:0:15762:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff9b773409b380) has exports, disconnecting them 00000020:00080000:0.0:1790779148.843250:0:15762:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9b7704184000), last request at 1790778932 00000020:00000080:0.0:1790779148.843255:0:15762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936ca60 00000020:00080000:0.0:1790779148.843272:0:15762:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b7704184000): rc 0 00000020:00000080:0.0:1790779148.843277:0:15762:0:(genops.c:885:class_export_put()) final put ffff9b7704184000/lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1790779148.843840:0:15762:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790779148.843845:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790779148.843847:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790779148.843850:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790779148.844020:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7601e10800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1790779148.844030:0:38:0:(genops.c:885:class_export_put()) final put ffff9b773f473000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1790779148.844033:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773f473000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1790779148.844039:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1790779148.844102:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704184000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1790779148.844107:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773f472000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1790779148.844951:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1790779148.865054:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1790779148.865274:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1790779148.865487:0:6506:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b77114e9c00:6506] 0 exiting: rc = 1 00000100:00100000:3.0:1790779148.865583:0:6507:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b771db31800:6507] 1 exiting: rc = 0 00000100:00100000:1.0:1790779148.865708:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.866050:0:7465:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b773429c200:7465] 3 exiting: rc = 0 00000100:00100000:0.0:1790779148.866099:0:6508:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b771db31a00:6508] 0 exiting: rc = 1 00000100:00100000:2.0:1790779148.866122:0:6510:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b771db31000:6510] 2 exiting: rc = 0 00000100:00100000:3.0:1790779148.866279:0:6509:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b771db30400:6509] 1 exiting: rc = 0 00000100:00100000:1.0:1790779148.866413:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866420:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866427:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866432:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866437:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866443:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866449:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866454:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866460:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866466:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866471:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866476:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866481:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866487:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866493:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866498:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866504:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866510:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866515:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866521:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866537:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866542:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866548:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866553:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866558:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866562:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866567:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866572:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866577:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866583:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866588:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866592:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866597:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866602:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866607:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866612:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866617:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866622:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866627:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866631:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866636:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866641:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866646:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866651:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866657:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866662:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866667:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866673:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866681:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866688:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866703:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866709:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866714:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866719:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866724:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866736:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866743:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866760:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866766:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866771:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866776:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866781:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866787:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.866793:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790779148.867915:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779148.867926:0:15762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1790779148.867931:0:15762:0:(genops.c:885:class_export_put()) final put ffff9b760310f800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1790779148.867935:0:15762:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760310f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1790779148.867940:0:15762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1790779148.867987:0:15762:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b760310d000 1 00000020:00000080:1.0:1790779148.868004:0:15762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936c9f0 00000020:00000080:1.0:1790779148.868010:0:15762:0:(genops.c:885:class_export_put()) final put ffff9b773b6d2800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1790779148.868018:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1790779148.868100:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1790779148.868110:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779148.868115:0:15762:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790779148.868118:0:15762:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff9b77340999c0) has no exports 00000020:00000080:1.0:1790779148.967557:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779148.967571:0:15762:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790779148.967576:0:15762:0:(genops.c:885:class_export_put()) final put ffff9b760310d800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790779148.967581:0:15762:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760310d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790779148.967587:0:15762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790779148.969294:0:15762:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b7603108800 00000020:01000000:1.0:1790779148.969322:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790779148.969330:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779148.969336:0:15762:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790779148.969341:0:15762:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9b77041cb380) has no exports 00000020:00000080:1.0:1790779148.969390:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779148.969400:0:15762:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790779148.969405:0:15762:0:(genops.c:885:class_export_put()) final put ffff9b770411a800/OSS_uuid 00000020:00000080:1.0:1790779148.969408:0:15762:0:(genops.c:844:class_export_destroy()) destroying export ffff9b770411a800/OSS_uuid for OSS 00000020:01000000:1.0:1790779148.969414:0:15762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1790779148.969866:0:6519:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1790779148.972074:0:14675:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff9b77055c8600:14675] 4 exiting: rc = 0 00000100:00100000:2.0:1790779148.972421:0:8855:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff9b7601dfb200:8855] 3 exiting: rc = 0 00000100:00100000:1.0:1790779148.972981:0:8438:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff9b7734299400:8438] 0 exiting: rc = 1 00000100:00100000:1.0:1790779148.973144:0:8440:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff9b773455a000:8440] 2 exiting: rc = 0 00000100:00100000:0.0:1790779148.973477:0:8439:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff9b773455b000:8439] 1 exiting: rc = 0 00000100:00100000:1.0:1790779148.976262:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976276:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976281:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976291:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976298:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976302:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976307:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976312:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976317:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976321:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976326:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976336:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976344:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976349:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976354:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976359:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976363:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976368:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976373:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976377:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976382:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976387:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976391:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976395:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976401:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976406:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976411:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976416:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976433:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976438:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976444:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976449:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976454:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976459:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976464:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976469:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976474:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976479:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976484:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976489:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976493:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976498:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976503:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976507:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976512:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976516:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976521:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976526:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976531:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976536:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976541:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976546:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976551:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976556:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976561:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976566:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976570:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976574:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976579:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976584:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976590:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976595:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976600:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.976616:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.978037:0:10360:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9b7603791c00:10360] 2 exiting: rc = 0 00000100:00100000:3.0:1790779148.980986:0:8441:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b77411d5c00:8441] 0 exiting: rc = 1 00000100:00100000:3.0:1790779148.981108:0:8442:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b773b50e400:8442] 1 exiting: rc = 0 00000100:00100000:2.0:1790779148.981359:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981367:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981372:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981377:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981382:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981386:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981391:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981412:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981418:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981423:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981429:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981434:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981440:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981445:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981451:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981456:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981461:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981467:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981472:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981477:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981482:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981487:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981493:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981497:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981502:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981507:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981512:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981517:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981523:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981528:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981535:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981541:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981546:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981551:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981556:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981562:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981566:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981572:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981576:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981581:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981587:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981592:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981604:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981610:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981615:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981620:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981626:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981632:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981638:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981644:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981649:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981655:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981741:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981836:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981846:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981851:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981856:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981861:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981866:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981871:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.981876:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.982115:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.982120:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.982126:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779148.983451:0:8445:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b7712a65800:8445] 2 exiting: rc = 0 00000100:00100000:1.0:1790779148.983922:0:8443:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b7735b8e600:8443] 0 exiting: rc = 1 00000100:00100000:2.0:1790779148.984197:0:8444:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b773429e600:8444] 1 exiting: rc = 0 00000100:00100000:0.0:1790779148.986164:0:14330:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9b7709e07800:14330] 3 exiting: rc = 0 00000100:00100000:0.0:1790779148.986284:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986293:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986298:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986304:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986309:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986321:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986334:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986353:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986359:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986365:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986370:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986376:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986381:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986387:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986393:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986399:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986404:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986410:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986415:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986421:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986427:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986433:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986439:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986445:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986450:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986457:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986462:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986468:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986474:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986479:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986499:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986505:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986510:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986516:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986521:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986526:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986531:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986537:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986543:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986548:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986554:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986560:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986572:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986577:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986582:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986588:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986594:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986599:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986604:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986610:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986617:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986622:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986628:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986634:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.986649:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.987079:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.987106:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.987113:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.987119:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.987125:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.987130:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.987138:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.987144:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779148.987150:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779148.996274:0:8447:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b7735fcbc00:8447] 1 exiting: rc = 0 00000100:00100000:2.0:1790779148.996435:0:8446:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b7735fca200:8446] 0 exiting: rc = 1 00000100:00100000:1.0:1790779148.996525:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996533:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996539:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996545:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996550:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996555:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996560:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996565:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996570:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996576:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996582:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996587:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996593:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996598:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996603:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996609:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996614:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996619:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996624:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996630:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996634:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996639:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996644:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996649:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996655:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996740:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996746:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996801:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996807:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996812:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996818:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996825:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996831:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996851:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996856:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996861:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996867:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996871:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.996876:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997040:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997046:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997051:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997056:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997061:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997068:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997074:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997079:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997085:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997091:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997096:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997102:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997107:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997112:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997117:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997122:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997128:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997134:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997140:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997145:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997150:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997155:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997161:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997167:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779148.997172:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779148.999981:0:8448:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b773455b200:8448] 0 exiting: rc = 1 00000100:00100000:0.0:1790779149.000122:0:8449:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b7601d0e200:8449] 1 exiting: rc = 0 00000100:00100000:1.0:1790779149.000215:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000223:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000229:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000235:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000271:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000279:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000285:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000290:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000296:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000302:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000307:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000312:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000318:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000324:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000330:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000335:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000353:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000361:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000366:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000371:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000376:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000382:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000387:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000393:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000398:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000403:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000408:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000413:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000430:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000436:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000442:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000448:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000453:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000460:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000465:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000471:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000476:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000481:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000487:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000499:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000517:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000524:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000529:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000535:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000541:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000547:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000553:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000559:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000565:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000571:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000578:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000584:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000605:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000611:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000617:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000623:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000630:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000637:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000642:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000648:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.000654:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.001783:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.001795:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779149.001802:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790779149.018553:0:15762:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1790779169.433514:0:16525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1790779180.412544:0:17125:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790779180.412552:0:17125:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1790779180.412554:0:17125:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1790779180.412666:0:17125:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b7604541000 00000020:01000004:3.0:1790779180.412684:0:17125:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1790779180.412691:0:17125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790779180.412707:0:17125:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b773b7819c0) 00000020:00000080:3.0:1790779180.412722:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790779180.500501:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790779180.503097:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1790779180.507512:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1790779180.510387:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1790779180.514751:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1790779180.515418:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1790779180.515771:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1790779180.516588:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1790779180.516994:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1790779180.517208:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1790779180.517501:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1790779180.518562:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1790779180.520188:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1790779180.520704:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1790779180.520942:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1790779180.523318:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.523837:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.524132:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.524388:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.524710:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.524936:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.525151:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.525360:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.525682:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.525937:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.526153:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.526360:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.526690:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.528268:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.528709:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.529148:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.529503:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.529869:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.530301:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.531080:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.532017:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.532291:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.532587:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.532987:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.533164:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.533344:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.533543:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.534155:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.534335:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.534523:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.534991:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1790779180.535194:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1790779180.536970:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1790779180.537299:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1790779180.537516:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1790779180.538278:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1790779180.538708:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1790779180.540186:0:17125:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:0.0:1790779180.540976:0:17125:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790779180.541187:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1790779180.541196:0:17125:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790779180.541208:0:17125:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936dc26 00000020:01000004:0.0:1790779180.541214:0:17125:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1790779180.541219:0:17125:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1790779180.541224:0:17125:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b7604541000 from MGS 00000020:01000004:0.0:1790779180.541228:0:17125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1790779180.541238:0:17125:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b76032219c0) 00000020:00000080:0.0:1790779180.541249:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1790779180.541310:0:17125:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b7604541000 from MGS, refs=2 00080000:01000000:0.0:1790779180.541315:0:17125:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790779180.541321:0:17125:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936dc34 00000100:00100000:0.0:1790779180.541410:0:17125:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790779180.542032:0:17125:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790779180.542045:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790779180.542421:0:17125:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790779180.542502:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790779180.543312:0:17125:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779180.544205:0:17125:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790779180.544213:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790779180.545135:0:17125:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790779180.545144:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790779180.545542:0:17125:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790779180.545549:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790779180.551186:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779180.551198:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779180.551200:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779180.551574:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779180.551577:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779180.551578:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779180.552239:0:17125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790779180.556708:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790779180.557190:0:17125:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1790779180.558086:0:17137:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790779180.558131:0:17125:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790779180.558168:0:17125:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790779180.559008:0:17125:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790779180.559283:0:17125:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790779180.560016:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790779180.560025:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790779180.566952:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790779180.566968:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790779180.567309:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790779180.567316:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790779180.569348:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790779180.569372:0:17125:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.103@tcp' 00000020:01000004:3.0:1790779180.569374:0:17125:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790779180.569404:0:17125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.103@tcp (typ=mgc) 00000020:00000080:3.0:1790779180.569417:0:17125:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.103@tcp (ffff9b773b784d40) 00000100:00080000:2.0:1790779180.569574:0:17142:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1790779180.570542:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790779180.570933:0:17125:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b770ea17000@MGC192.168.203.103@tcp: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1790779180.571113:0:17125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.103@tcp-0 is initialized 00000040:01000000:3.0:1790779180.571119:0:17125:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 1 is initialized 10000000:01000000:3.0:1790779180.576751:0:17143:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1790779180.579121:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.103@tcp (uuid f89954ec-b1b4-4b66-a198-81b81a38f825) 00000020:00000080:0.0:1790779180.579151:0:17125:0:(genops.c:1384:class_connect()) connect: client f89954ec-b1b4-4b66-a198-81b81a38f825, cookie 0xb1aa4014e936dc42 00000100:00080000:0.0:1790779180.579164:0:17125:0:(import.c:545:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790779180.579176:0:17125:0:(import.c:666:import_select_connection()) MGC192.168.203.103@tcp: import ffff9b770ea17000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779180.579210:0:17125:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b76046cf480 x1877767663815552/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779180.579285:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f89954ec-b1b4-4b66-a198-81b81a38f825:3648:1877767663815552:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790779180.579346:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790779180.579415:0:17125:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f89954ec-b1b4-4b66-a198-81b81a38f825->MGS 00000020:01000004:0.0:1790779180.579444:0:17125:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790779180.579449:0:17125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790779180.579472:0:17125:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b7603223380) 00000020:00000080:0.0:1790779180.579484:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790779180.581852:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663815552 00000100:00100000:2.0:1790779180.581873:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663815552 00000100:00100000:2.0:1790779180.581922:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779180.581929:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3648:x1877767663815552:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1790779180.581954:0:17138:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f89954ec-b1b4-4b66-a198-81b81a38f825@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:2.0:1790779180.581980:0:17138:0:(genops.c:1384:class_connect()) connect: client f89954ec-b1b4-4b66-a198-81b81a38f825, cookie 0xb1aa4014e936dc50 00000100:00080000:2.0:1790779180.582102:0:17138:0:(import.c:65:import_set_state_nolock()) ffff9b773f632800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779180.586253:0:3648:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.103@tcp: committing for last_committed 0 gen 1 00000100:00100000:2.0:1790779180.586262:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+5:3648:x1877767663815552:12345-0@lo:250:mount.lustre.0 Request processed in 4323us (6906us total) trans 0 rc 0/0 00000100:00080000:3.0:1790779180.586270:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.103@tcp: connect to target with instance 0 00000100:00100000:2.0:1790779180.586277:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790779180.586291:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790779180.586298:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790779180.586303:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b770ea17000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790779180.586307:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790779180.586317:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790779180.586325:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f89954ec-b1b4-4b66-a198-81b81a38f825:3648:1877767663815552:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790779180.594972:0:17125:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790779180.595172:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790779180.595178:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790779180.597374:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790779180.597388:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790779180.598356:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790779180.598365:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790779180.599181:0:17125:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790779180.599338:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790779180.599343:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790779180.603065:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1790779180.603080:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790779180.666672:0:17125:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779180.666918:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790779180.666925:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790779180.669106:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790779180.669119:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790779180.679660:0:17125:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779180.680208:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790779180.680215:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790779180.682746:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790779180.682768:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790779180.683521:0:17125:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779180.683702:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790779180.683708:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790779180.684795:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790779180.684805:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790779180.685471:0:17125:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779180.685773:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790779180.685780:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790779180.687472:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790779180.687485:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790779180.712733:0:17125:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779180.715079:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790779180.715086:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790779180.717380:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790779180.717395:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790779180.718305:0:17125:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790779180.718313:0:17125:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790779180.719763:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790779180.719793:0:17125:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1790779180.719799:0:17125:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790779180.719946:0:17125:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790779180.719976:0:17125:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790779180.719981:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790779180.719985:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790779180.719987:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779180.719988:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779180.719989:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779180.719990:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779180.719991:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790779180.719992:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790779180.719994:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779180.719995:0:17125:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779180.719998:0:17125:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790779180.720000:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790779180.720001:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790779180.720002:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779180.720003:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779180.720004:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779180.720005:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779180.720006:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790779180.720007:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790779180.720008:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779180.720009:0:17125:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779180.720033:0:17125:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790779180.720051:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663815680:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790779180.720114:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.720155:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8900 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.720304:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663815680 00000100:00100000:0.0:1790779180.720311:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663815680 00000100:00100000:0.0:1790779180.720366:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790779180.720375:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+5:17125:x1877767663815680:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790779180.720422:0:17141:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790779180.720425:0:17141:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790779180.720428:0:17141:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1790779180.721238:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790779180.721752:0:17141:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1790779180.723305:0:17163:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790779180.723312:0:17163:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1790779180.723315:0:17163:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790779180.723317:0:17163:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1790779180.723502:0:17163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1790779180.723708:0:17141:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790779180.723717:0:17141:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790779180.727339:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+5:17125:x1877767663815680:12345-0@lo:253:mount.lustre.0 Request processed in 6954us (7212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779180.727356:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779180.727438:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663815680:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790779180.727461:0:17125:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790779180.727466:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790779180.727468:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790779180.727469:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779180.727470:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779180.727471:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779180.727472:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779180.727473:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790779180.727489:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790779180.727492:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779180.727493:0:17125:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790779180.727513:0:17125:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b7604541000 from lustre-MDT0000 10000000:01000000:2.0:1790779180.727548:0:17125:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790779180.727551:0:17125:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790779180.727556:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b773b784d40 10000000:01000000:2.0:1790779180.727560:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790779180.727569:0:17125:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b773b784d40 from 1 10000000:01000000:2.0:1790779180.727572:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790779180.727689:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.727702:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.727713:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779180.727733:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663815808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779180.727769:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.727805:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663815808 00000100:00100000:2.0:1790779180.727811:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663815808 00000100:00100000:2.0:1790779180.727847:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779180.727855:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+5:17125:x1877767663815808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779180.727868:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779180.727911:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a3800/0xb1aa4014e936dc5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936dc57 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.727934:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3800/0xb1aa4014e936dc5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936dc57 expref: 6 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.727955:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a3800/0xb1aa4014e936dc5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dc57 expref: 6 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.727964:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3800, rc 0) 00000100:00100000:2.0:1790779180.727988:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+6:17125:x1877767663815808:12345-0@lo:101:mount.lustre.0 Request processed in 134us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779180.727994:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779180.728029:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1790779180.728040:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663815808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779180.728051:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.728060:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779180.728101:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663815936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779180.728122:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.728139:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663815936 00000100:00100000:2.0:1790779180.728143:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663815936 00000100:00100000:2.0:1790779180.728159:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779180.728165:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+6:17125:x1877767663815936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779180.728223:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+6:17125:x1877767663815936:12345-0@lo:501:mount.lustre.0 Request processed in 58us (100us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790779180.728229:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779180.728247:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1790779180.728256:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663815936:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790779180.728285:0:17125:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790779180.728296:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.728305:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779180.728312:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b7604541000 10000000:01000000:2.0:1790779180.728315:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790779180.728319:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b7604541000 10000000:01000000:2.0:1790779180.728321:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790779180.728323:0:17125:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b7604541000 from 1 10000000:01000000:2.0:1790779180.728325:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790779180.728339:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.728346:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.728354:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779180.728364:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663816064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779180.728386:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.728403:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663816064 00000100:00100000:2.0:1790779180.728406:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663816064 00000100:00100000:2.0:1790779180.728422:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779180.728427:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+6:17125:x1877767663816064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779180.728433:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779180.728449:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936dc6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936dc65 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.728474:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936dc6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936dc65 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.728482:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936dc6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dc65 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.728489:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3c00, rc 0) 00000100:00100000:2.0:1790779180.728510:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+7:17125:x1877767663816064:12345-0@lo:101:mount.lustre.0 Request processed in 83us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779180.728516:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779180.728536:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1790779180.728545:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663816064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779180.728554:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.728561:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779180.728571:0:17125:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790779180.728574:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.728581:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779180.728587:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790779180.730225:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790779180.730233:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b7604541000 10000000:01000000:2.0:1790779180.730235:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790779180.730239:0:17125:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790779180.730242:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790779180.730274:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.730284:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.730294:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779180.730315:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663816192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779180.730369:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.730444:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8300 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.737272:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663816192 00000100:00100000:0.0:1790779180.737286:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663816192 00000100:00100000:0.0:1790779180.737345:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790779180.737354:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+7:17125:x1877767663816192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779180.737371:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779180.737390:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768000/0xb1aa4014e936dc7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936dc73 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.737417:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768000/0xb1aa4014e936dc7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936dc73 expref: 8 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.737439:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768000/0xb1aa4014e936dc7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dc73 expref: 8 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.737447:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768000, rc 0) 00000100:00100000:0.0:1790779180.737534:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+8:17125:x1877767663816192:12345-0@lo:101:mount.lustre.0 Request processed in 180us (7163us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779180.737541:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779180.737982:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663816192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779180.738003:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779180.738013:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779180.738088:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663816320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779180.738124:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779180.738165:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b774123af00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.738220:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663816320 00000100:00100000:0.0:1790779180.738225:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663816320 00000100:00100000:0.0:1790779180.738262:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790779180.738270:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+8:17125:x1877767663816320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779180.738403:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+9:17125:x1877767663816320:12345-0@lo:501:mount.lustre.0 Request processed in 133us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779180.738432:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779180.738586:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663816320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779180.738620:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663816448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779180.738654:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779180.738674:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b774123af00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.739318:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663816448 00000100:00100000:0.0:1790779180.739324:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663816448 00000100:00100000:0.0:1790779180.739363:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779180.739372:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+9:17125:x1877767663816448:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779180.740408:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+9:17125:x1877767663816448:12345-0@lo:503:mount.lustre.0 Request processed in 1033us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779180.740418:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790779180.740527:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663816448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779180.741071:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17164:1877767663816576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779180.741116:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779180.741150:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711bee240 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.741199:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663816576 00000100:00100000:0.0:1790779180.741205:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663816576 00000100:00100000:0.0:1790779180.741238:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790779180.741246:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+9:17164:x1877767663816576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779180.742004:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+9:17164:x1877767663816576:12345-0@lo:502:llog_process_th.0 Request processed in 756us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779180.742012:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790779180.742104:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17164:1877767663816576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790779180.742133:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779180.742143:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779180.742146:0:17164:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790779180.742151:0:17164:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790779180.742154:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779180.742169:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b77041c8000) 00000020:00000080:1.0:1790779180.742185:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790779180.742191:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790779180.742279:0:17164:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790779180.742288:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936dc88 00000020:00000080:1.0:1790779180.742507:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790779180.742512:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779180.742515:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779180.742517:0:17164:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790779180.742520:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779180.742524:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779180.742525:0:17164:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790779180.742529:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779180.742537:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b77041cb380) 00000020:00000080:1.0:1790779180.742548:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790779180.742560:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790779180.742562:0:17164:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790779180.742565:0:17164:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790779180.742571:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790779180.742737:0:17164:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b7604541000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790779180.742750:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b77041ccd40) 00000020:00000080:1.0:1790779180.742758:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790779180.742808:0:17164:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790779180.742813:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936dc9d 00000020:00000080:1.0:1790779180.743017:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790779180.743023:0:17164:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790779180.743028:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb1aa4014e936dca4 00080000:01000000:1.0:1790779180.743034:0:17164:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790779180.743037:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936dcab 00010000:00010000:3.0:1790779180.874027:0:17164:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1790779180.874961:0:17164:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1790779180.875508:0:17164:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790779180.876271:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b773b780000) 00000020:00000080:3.0:1790779180.876290:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790779180.876705:0:17164:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790779180.876714:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936dcb9 00000020:00000080:1.0:1790779180.884574:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790779180.889756:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb1aa4014e936dcc0 00000020:00000080:1.0:1790779180.890556:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790779180.890573:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779180.890580:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779180.890582:0:17164:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790779180.890585:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790779180.890588:0:17164:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1790779180.890590:0:17164:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779180.890591:0:17164:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779180.890593:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790779180.890595:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779180.890597:0:17164:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790779180.890599:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779180.890604:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779180.890605:0:17164:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790779180.890609:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790779180.890652:0:17164:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790779180.890665:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779180.890669:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779180.890670:0:17164:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790779180.890683:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779180.890686:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779180.890688:0:17164:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1790779180.890690:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790779180.890696:0:17164:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:1.0:1790779180.890724:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779180.890740:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9b77041c99c0) 00000020:00000080:1.0:1790779180.891238:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1790779180.891250:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790779180.891317:0:17164:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1790779180.891323:0:17164:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790779180.891405:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936dcce 00010000:00080000:1.0:1790779180.891444:0:17164:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7704183800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1790779180.894584:0:17164:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1790779180.898136:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790779180.898153:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790779180.898193:0:17164:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790779180.898215:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936dcd5 00000100:00080000:1.0:1790779180.898225:0:17164:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790779180.898308:0:17164:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b7704183800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779180.898346:0:17164:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603bd1c00 x1877767663816704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779180.898494:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663816704:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790779180.898561:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790779180.898641:0:17164:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1790779180.898702:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779180.898706:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779180.898708:0:17164:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1790779180.898711:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790779180.898714:0:17164:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1790779180.898716:0:17164:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779180.898717:0:17164:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779180.898719:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790779180.898737:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779180.898739:0:17164:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790779180.898742:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790779180.898748:0:17164:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1790779180.898752:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779180.898753:0:17164:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790779180.898756:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790779180.898760:0:17164:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:1.0:1790779180.898780:0:17164:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790779180.898783:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779180.898796:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b77340fcd40) 00000020:00000080:1.0:1790779180.898809:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790779180.898814:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790779180.898916:0:17164:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790779180.898923:0:17164:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790779180.898930:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936dce3 00000100:00100000:0.0:1790779180.899127:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663816704 00000100:00100000:0.0:1790779180.899136:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663816704 00000100:00100000:0.0:1790779180.899163:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790779180.899171:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663816704:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1790779180.899187:0:17151:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1790779180.901111:0:17164:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b773b543800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1790779180.901598:0:17164:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1790779180.903584:0:17164:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790779180.903790:0:17164:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790779180.908017:0:17164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779180.910472:0:17164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1790779180.917835:0:17164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790779180.930586:0:17170:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790779180.930597:0:17170:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1790779180.932192:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663816704:12345-0@lo:38:llog_process_th.0 Request processed in 33013us (33622us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790779180.932211:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:3.0:1790779180.932867:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790779180.932916:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790779180.933088:0:17164:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790779180.933110:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936dcea 00000100:00080000:3.0:1790779180.933119:0:17164:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790779180.933128:0:17164:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b773b543800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779180.933162:0:17164:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773f4f6300 x1877767663816832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779180.933179:0:17164:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790779180.933254:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779180.933259:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779180.933261:0:17164:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790779180.933265:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790779180.933268:0:17164:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1790779180.933269:0:17164:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790779180.933271:0:17164:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790779180.933273:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790779180.933275:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779180.933277:0:17164:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790779180.933280:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790779180.933284:0:17164:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1790779180.933287:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779180.933289:0:17164:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790779180.933292:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790779180.933296:0:17164:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:3.0:1790779180.933329:0:17164:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790779180.933333:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790779180.933344:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b773b783380) 00000020:00000080:3.0:1790779180.933355:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1790779180.933360:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790779180.933570:0:17164:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790779180.933578:0:17164:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:3.0:1790779180.933584:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936dcf8 00010000:00080000:3.0:1790779180.933626:0:17164:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7704186000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1790779180.933864:0:17164:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1790779180.934147:0:17164:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790779180.934165:0:17164:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790779180.936627:0:17164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779180.937160:0:17164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1790779180.937491:0:17164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1790779180.937567:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663816832:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790779180.937647:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663816832 offset 0 length 520: 4 00000100:00080000:0.0:1790779180.937713:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790779180.937718:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790779180.937729:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663816704:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1790779180.938282:0:17172:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790779180.938287:0:17172:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790779180.939210:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790779180.939223:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790779180.939338:0:17164:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790779180.939361:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936dcff 00000100:00080000:3.0:1790779180.939371:0:17164:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790779180.939382:0:17164:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b7704186000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779180.939501:0:17164:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773f4f4a80 x1877767663816960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790779180.939559:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663816960:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790779180.939613:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663816960 offset 0 length 520: 4 00000100:00080000:3.0:1790779180.939669:0:17164:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790779180.939726:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779180.939730:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779180.939732:0:17164:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790779180.939734:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779180.939746:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779180.939748:0:17164:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790779180.939752:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790779180.939754:0:17164:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790779180.939756:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779180.939758:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779180.939760:0:17164:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790779180.939762:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779180.939764:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779180.939766:0:17164:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790779180.939769:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790779180.939799:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17164:1877767663817088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779180.939847:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779180.939868:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771d81b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779180.940240:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663817088 00000100:00100000:2.0:1790779180.940248:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663817088 00000100:00100000:2.0:1790779180.940293:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790779180.940301:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+9:17164:x1877767663817088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779180.940437:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+9:17164:x1877767663817088:12345-0@lo:502:llog_process_th.0 Request processed in 136us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779180.940445:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779180.940661:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17164:1877767663817088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790779180.940686:0:17164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779180.940691:0:17164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779180.940692:0:17164:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790779180.940696:0:17164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1790779180.940863:0:17125:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1790779180.940915:0:17125:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790779180.940933:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.941065:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779180.941074:0:17125:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7604541000 from 1 10000000:01000000:2.0:1790779180.941077:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790779180.941104:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.941113:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.941121:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779180.941135:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663817216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779180.941169:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.941198:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779180.941399:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663817216 00000100:00100000:1.0:1790779180.941405:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663817216 00000100:00100000:1.0:1790779180.941461:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790779180.941470:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+9:17125:x1877767663817216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779180.941480:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779180.941500:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936dd0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936dd06 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779180.941521:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936dd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936dd06 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779180.941531:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936dd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dd06 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779180.941539:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6e00, rc 0) 00000100:00100000:1.0:1790779180.941583:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+10:17125:x1877767663817216:12345-0@lo:101:mount.lustre.0 Request processed in 115us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779180.941589:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790779180.941748:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663817216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779180.941761:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779180.941770:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779180.942522:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663817344:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790779180.942573:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779180.942606:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771d81b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779180.942798:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663817344 00000100:00100000:2.0:1790779180.942805:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663817344 00000100:00100000:2.0:1790779180.942839:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779180.942848:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+10:17125:x1877767663817344:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790779180.942874:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790779180.942908:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790779180.943119:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+10:17125:x1877767663817344:12345-0@lo:256:mount.lustre.0 Request processed in 272us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779180.943128:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779180.943226:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663817344:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790779180.944599:0:17125:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790779180.944630:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779180.944644:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779180.944800:0:17125:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7604541000 from 1 10000000:01000000:2.0:1790779180.944813:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790779180.945150:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.945160:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.945171:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779180.945196:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663817472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779180.945335:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.945443:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.945557:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663817472 00000100:00100000:0.0:1790779180.945566:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663817472 00000100:00100000:0.0:1790779180.945659:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790779180.945669:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+10:17125:x1877767663817472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779180.945682:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779180.945698:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768800/0xb1aa4014e936dd1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936dd14 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.945723:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768800/0xb1aa4014e936dd1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936dd14 expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.945735:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768800/0xb1aa4014e936dd1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dd14 expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.945744:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768800, rc 0) 00000100:00100000:0.0:1790779180.945802:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+11:17125:x1877767663817472:12345-0@lo:101:mount.lustre.0 Request processed in 135us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779180.945809:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790779180.945906:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663817472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779180.945921:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779180.945930:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779180.946000:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663817600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779180.946026:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.946607:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779180.946744:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663817600 00000100:00100000:1.0:1790779180.946751:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663817600 00000100:00100000:1.0:1790779180.946780:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790779180.946787:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+11:17125:x1877767663817600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779180.947130:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+11:17125:x1877767663817600:12345-0@lo:501:mount.lustre.0 Request processed in 342us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779180.947138:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790779180.947332:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663817600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779180.947369:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663817728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779180.947431:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.947467:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779180.947581:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663817728 00000100:00100000:1.0:1790779180.947586:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663817728 00000100:00100000:1.0:1790779180.947620:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790779180.947628:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+11:17125:x1877767663817728:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779180.947710:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+11:17125:x1877767663817728:12345-0@lo:503:mount.lustre.0 Request processed in 84us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779180.947717:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790779180.947873:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663817728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779180.948656:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17174:1877767663817856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779180.948705:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.948741:0:17174:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71180 going to sleep for 11 seconds 00000100:00100000:1.0:1790779180.948792:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663817856 00000100:00100000:1.0:1790779180.948804:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663817856 00000100:00100000:1.0:1790779180.948841:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790779180.948849:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+11:17174:x1877767663817856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779180.949527:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+11:17174:x1877767663817856:12345-0@lo:502:llog_process_th.0 Request processed in 677us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779180.949536:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790779180.949831:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17174:1877767663817856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790779180.949870:0:17174:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779180.949911:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779180.949914:0:17174:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790779180.949922:0:17174:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b7604541000 00000020:00000080:2.0:1790779180.949924:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790779180.949931:0:17174:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779180.949934:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779180.949935:0:17174:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790779180.949937:0:17174:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779180.949940:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779180.949941:0:17174:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790779180.949944:0:17174:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b7604541000 00000020:00000080:2.0:1790779180.949946:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790779180.950017:0:17174:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779180.950021:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779180.950022:0:17174:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790779180.950025:0:17174:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779180.950028:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779180.950029:0:17174:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790779180.950033:0:17174:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b7604541000 00000020:00000080:2.0:1790779180.950035:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790779180.950053:0:17174:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779180.950055:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779180.950057:0:17174:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790779180.950059:0:17174:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779180.950061:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779180.950063:0:17174:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790779180.950072:0:17174:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b7604541000 00000020:00000080:2.0:1790779180.950074:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790779180.950117:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17174:1877767663817984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779180.950160:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.950184:0:17174:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71180 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.950346:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663817984 00000100:00100000:0.0:1790779180.950352:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663817984 00000100:00100000:0.0:1790779180.950392:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790779180.950402:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+11:17174:x1877767663817984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779180.950517:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+11:17174:x1877767663817984:12345-0@lo:502:llog_process_th.0 Request processed in 117us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779180.950532:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790779180.951330:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17174:1877767663817984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790779180.951359:0:17174:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779180.951366:0:17174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779180.951368:0:17174:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790779180.951371:0:17174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1790779180.953828:0:17125:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790779180.953904:0:17125:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779180.953925:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.953939:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779180.954004:0:17125:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790779180.954007:0:17125:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b7604541000 10000000:01000000:0.0:1790779180.954010:0:17125:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b7604541000 10000000:01000000:0.0:1790779180.954014:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790779180.954020:0:17125:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b7604541000 from 1 10000000:01000000:0.0:1790779180.954022:0:17125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790779180.954059:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.954068:0:17125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.954079:0:17125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779180.954104:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663818112:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790779180.954168:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779180.954207:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771824d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.954356:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663818112 00000100:00100000:0.0:1790779180.954364:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663818112 00000100:00100000:0.0:1790779180.954416:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790779180.954502:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+11:17125:x1877767663818112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779180.954516:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779180.954529:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769400/0xb1aa4014e936dd29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936dd22 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.954551:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769400/0xb1aa4014e936dd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936dd22 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.954561:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769400/0xb1aa4014e936dd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dd22 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.954569:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769400, rc 0) 00000100:00100000:0.0:1790779180.954607:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17125:x1877767663818112:12345-0@lo:101:mount.lustre.0 Request processed in 110us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779180.954615:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790779180.954663:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663818112:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779180.954677:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.954685:0:17125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779180.954739:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663818240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779180.954771:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779180.954786:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771824d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.954798:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663818240 00000100:00100000:0.0:1790779180.954802:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663818240 00000100:00100000:0.0:1790779180.954829:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790779180.954836:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17125:x1877767663818240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779180.956102:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17125:x1877767663818240:12345-0@lo:501:mount.lustre.0 Request processed in 1261us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779180.956113:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790779180.957086:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663818240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779180.957139:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663818368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779180.957202:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779180.957254:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771d81b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.958131:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663818368 00000100:00100000:0.0:1790779180.958139:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663818368 00000100:00100000:0.0:1790779180.958190:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790779180.958200:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17125:x1877767663818368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779180.958660:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17125:x1877767663818368:12345-0@lo:503:mount.lustre.0 Request processed in 461us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779180.958668:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790779180.968956:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663818368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779180.973267:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17178:1877767663818496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779180.973353:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779180.973400:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771d81b600 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.973410:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663818496 00000100:00100000:0.0:1790779180.973418:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663818496 00000100:00100000:0.0:1790779180.973470:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790779180.973479:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17178:x1877767663818496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779180.973606:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17178:x1877767663818496:12345-0@lo:502:llog_process_th.0 Request processed in 128us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779180.973614:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790779180.975282:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17178:1877767663818496:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1790779180.975352:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790779180.975370:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b773059cd40) 00000020:00000080:3.0:1790779180.975391:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1790779180.975490:0:17178:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b7604541000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790779180.975495:0:17178:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b7604541000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790779180.975498:0:17178:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b7604541000 4 00010000:00080000:3.0:1790779180.975529:0:17178:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b77344a5000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1790779180.978508:0:17178:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1790779180.978741:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790779180.978782:0:17178:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790779180.978799:0:17178:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb1aa4014e936dd37 00000100:00080000:3.0:1790779180.978809:0:17178:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790779180.978820:0:17178:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b77344a5000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779180.978854:0:17178:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773f4f4000 x1877767663818624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779180.978913:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663818624:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790779180.978978:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779180.979045:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663818624 00000100:00100000:3.0:1790779180.979051:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663818624 00000100:00100000:3.0:1790779180.982479:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790779180.982500:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663818624:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790779180.982600:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663818624:12345-0@lo:38:llog_process_th.0 Request processed in 102us (3620us total) trans 0 rc -11/-11 00000100:00080000:2.0:1790779180.984748:0:17178:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790779180.986507:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17178:1877767663818752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779180.986592:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779180.986628:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663818752 00000100:00100000:2.0:1790779180.986635:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663818752 00000100:00100000:2.0:1790779180.986683:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790779180.986692:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17178:x1877767663818752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779180.986822:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17178:x1877767663818752:12345-0@lo:502:llog_process_th.0 Request processed in 131us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779180.986871:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790779180.986929:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790779180.986937:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77344a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790779180.986942:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790779180.986946:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663818624:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790779180.987508:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71480 going to sleep for 11 seconds 00000100:00100000:3.0:1790779180.987527:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17178:1877767663818752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779180.987580:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17178:1877767663818880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779180.987631:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779180.987652:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771d81bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779180.988821:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663818880 00000100:00100000:0.0:1790779180.988831:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663818880 00000100:00100000:0.0:1790779180.988994:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790779180.989005:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+13:17178:x1877767663818880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779180.989197:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+13:17178:x1877767663818880:12345-0@lo:502:llog_process_th.0 Request processed in 195us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779180.989205:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790779180.991670:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f89954ec-b1b4-4b66-a198-81b81a38f825:17178:1877767663818880:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790779180.991716:0:17178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1790779180.993502:0:17125:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790779180.993544:0:17125:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790779180.993564:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779180.993578:0:17125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790779180.993652:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790779180.993654:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790779180.993656:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779180.993657:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779180.993658:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779180.993660:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779180.993661:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779180.993663:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790779180.993665:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779180.993666:0:17125:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790779180.993670:0:17125:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1790779180.993673:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790779180.993674:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790779180.993675:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779180.993676:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779180.993677:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779180.993678:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779180.993679:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779180.993680:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790779180.993681:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779180.993682:0:17125:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790779180.993719:0:17125:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790779180.993737:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663819008:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790779180.993810:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779180.993847:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663819008 00000100:00100000:0.0:1790779180.993866:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663819008 00000100:00100000:0.0:1790779180.993931:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790779180.993940:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+13:17125:x1877767663819008:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790779180.993978:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790779180.993992:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790779180.994410:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771824dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779180.997080:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 20000000:01000000:0.0:1790779181.001280:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790779181.001294:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790779181.001404:0:17162:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790779181.001409:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790779181.001436:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779181.001465:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936dd0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dd06 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779181.001474:0:17162:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779181.001517:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936dd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936dd06 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779181.001532:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936dd0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936dd06 expref: 12 pid: 17141 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779181.001546:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663819136:0@lo:104: 00000100:00100000:0.0:1790779181.001605:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779181.001649:0:17162:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771824d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779181.001836:0:17129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663819136 00000100:00100000:3.0:1790779181.001845:0:17129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663819136 00000100:00100000:3.0:1790779181.001911:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790779181.001920:0:17129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+3:17162:x1877767663819136:12345-0@lo:104: 00010000:00010000:3.0:1790779181.001932:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779181.001979:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790779181.001984:0:17129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+3:17162:x1877767663819136:12345-0@lo:104: Request processed in 65us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779181.001991:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790779181.002014:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779181.002019:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779181.002026:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779181.002029:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779181.002037:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779181.002044:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779181.002049:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790779181.002076:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779181.002083:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779181.002113:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779181.002120:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76039a2400/0xb1aa4014e936dd06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936dd0d expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779181.002594:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663819136:0@lo:104: 00010000:00010000:0.0:1790779181.002615:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779181.002678:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17125:x1877767663819008:12345-0@lo:253:mount.lustre.0 Request processed in 8739us (8867us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779181.002694:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790779181.002752:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17125:1877767663819008:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790779181.002762:0:17125:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790779181.002766:0:17125:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790779181.002768:0:17125:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790779181.002769:0:17125:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779181.002770:0:17125:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779181.002771:0:17125:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779181.002772:0:17125:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779181.002774:0:17125:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779181.002775:0:17125:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790779181.002777:0:17125:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779181.002779:0:17125:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790779181.002792:0:17125:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790779181.011075:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663819264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779181.011150:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779181.012185:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663819264 00000100:00100000:2.0:1790779181.012198:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663819264 00010000:00010000:2.0:1790779181.012239:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936dd0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936dd06 expref: 12 pid: 17141 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779181.012280:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779181.012290:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+12:3649:x1877767663819264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779181.012314:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779181.012320:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936dd0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936dd06 expref: 12 pid: 17141 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.012333:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936dd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936dd06 expref: 12 pid: 17141 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.012351:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936dd0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936dd06 expref: 12 pid: 17141 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.012368:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.012377:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790779181.012394:0:17131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010985934s 00010000:00010000:2.0:1790779181.012399:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.012406:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.012413:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.012430:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.012437:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779181.012442:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.012463:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779181.014970:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779181.014976:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779181.014979:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779181.015354:0:17162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779181.015368:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.015405:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.015415:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769000/0xb1aa4014e936dd3e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779181.015512:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779181.015635:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+11:3649:x1877767663819264:12345-0@lo:103:ldlm_bl.0 Request processed in 3343us (4481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779181.015646:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790779181.024019:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663819264:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1790779181.030064:0:17125:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1790779181.030349:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790779181.030414:0:17186:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1790779181.030418:0:17186:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1790779181.030694:0:17187:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1790779181.031079:0:17187:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779181.033168:0:17187:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790779181.033259:0:17187:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1790779181.033851:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1790779181.040954:0:17188:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9b773f4f5500 x1877767663819392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779181.040968:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00000040:01000000:1.0:1790779181.042182:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790779181.042227:0:17125:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790779181.045134:0:17125:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790779181.045153:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790779181.045245:0:17125:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779181.048179:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790779181.055243:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790779181.055547:0:17125:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1790779181.056845:0:17125:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1790779181.060392:0:17125:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1790779181.063755:0:17125:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790779181.063797:0:17125:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc92c1897988 00100000:10000000:2.0:1790779181.063806:0:17125:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790779181.064415:0:17125:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790779181.064439:0:17125:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790779181.064468:0:17125:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790779181.064489:0:17125:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1790779181.065551:0:17125:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790779181.065764:0:17125:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790779181.610644:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779182.056640:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00000040:00080000:1.0:1790779182.057494:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1790779182.440020:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790779182.440030:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7604541000 from 7 10000000:01000000:0.0:1790779182.440035:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790779182.440088:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779182.440115:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779182.440129:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779182.440157:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663819520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779182.440257:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779182.440331:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77036f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779182.440455:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663819520 00000100:00100000:2.0:1790779182.440463:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663819520 00000100:00100000:2.0:1790779182.440521:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790779182.440531:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+11:17143:x1877767663819520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779182.440544:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779182.440558:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936dd4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936dd45 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779182.440582:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936dd4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936dd45 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779182.440593:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936dd4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dd45 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779182.440627:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2a00, rc 0) 00000100:00100000:2.0:1790779182.440676:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17143:x1877767663819520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779182.440684:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790779182.440861:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663819520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779182.440911:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779182.440921:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779182.440984:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663819648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790779182.441032:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779182.441052:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f600 going to sleep for 11 seconds 00000100:00100000:2.0:1790779182.441148:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663819648 00000100:00100000:2.0:1790779182.441153:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663819648 00000100:00100000:2.0:1790779182.441182:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790779182.441189:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17143:x1877767663819648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790779182.441203:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790779182.441219:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790779182.441222:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1790779182.441315:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17143:x1877767663819648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779182.441323:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790779182.441619:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663819648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790779182.441667:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790779182.441675:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779182.441684:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779182.632117:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790779183.081209:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790779183.083454:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790779183.660663:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779184.121667:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790779184.685560:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779185.128862:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790779185.711975:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779186.152108:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00000001:02000400:0.0:1790779186.249184:0:17431:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1790779186.280301:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790779186.280308:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790779186.280312:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779186.280320:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1790779186.280327:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790779186.280337:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b7704183800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779186.280358:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773f4f4e00 x1877767663819904/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779186.280373:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779186.280396:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779186.280398:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779186.280401:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779186.280404:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790779186.280407:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790779186.280409:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b77344a5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779186.280424:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b77344a5000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779186.280439:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773f4f4000 x1877767663820032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779186.280466:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663819904:0@lo:38:kworker.0 00000100:00100000:3.0:1790779186.280525:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779186.280566:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663820032:0@lo:38:kworker.0 00000100:00100000:3.0:1790779186.280590:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779186.280629:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663820032 00000100:00100000:3.0:1790779186.280758:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663820032 00000100:00100000:3.0:1790779186.280787:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790779186.280794:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663820032:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1790779186.280817:0:17148:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1790779186.280859:0:17148:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb1aa4014e936dd53 00000004:00100000:3.0:1790779186.280872:0:17148:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790779186.281018:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9b760390a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779186.281068:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877767663820032:12345-0@lo:38:kworker.0 Request processed in 272us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779186.281075:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790779186.281119:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b773f4f4000 x1877767663820032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790779186.281133:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790779186.281139:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790779186.281144:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790779186.281146:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77344a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790779186.281151:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663820032:0@lo:38:kworker.0 00000100:00100000:2.0:1790779186.281496:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663819776:0@lo:400:kworker.0 00000100:00100000:2.0:1790779186.281539:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779186.281592:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663819904 00000100:00100000:2.0:1790779186.281597:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663819904 00000100:00100000:2.0:1790779186.281618:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779186.281623:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663819904:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790779186.281635:0:17152:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790779186.283961:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663819776 00000100:00100000:3.0:1790779186.283973:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663819776 00000100:00100000:3.0:1790779186.284028:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790779186.284037:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+12:3650:x1877767663819776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779186.284116:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+12:3650:x1877767663819776:12345-0@lo:400:kworker.0 Request processed in 79us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779186.284123:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790779186.287795:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663819776:0@lo:400:kworker.0 00000100:00100000:2.0:1790779186.294176:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663819904:12345-0@lo:38:kworker.0 Request processed in 12542us (13641us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790779186.294191:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790779186.294342:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790779186.294349:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790779186.294353:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663819904:0@lo:38:kworker.0 00010000:00010000:0.0:1790779186.728349:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779187.176694:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00000020:00000004:1.0:1790779187.445509:0:17483:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779187.445699:0:17483:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779187.752992:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779188.200128:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00000020:00000004:2.0:1790779188.266876:0:17533:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779188.267118:0:17533:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790779188.776042:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779189.225752:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790779189.800075:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779190.248002:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00000100:00100000:2.0:1790779190.375940:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779180/real 1790779180] req@ffff9b773f4f4a80 x1877767663816960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779190 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779190.375987:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b773f4f4a80 x1877767663816960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779190 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779190.376011:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779180/real 1790779180] req@ffff9b773f4f6300 x1877767663816832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779190 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779190.376038:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b773f4f6300 x1877767663816832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779190 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790779190.376070:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779190.376102:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790779190.376107:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663816960:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790779190.376114:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773b543800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779190.376131:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790779190.376135:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663816832:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1790779190.376622:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1790779190.379987:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790779190.379998:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790779190.380002:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779190.380011:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:3.0:1790779190.380017:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790779190.380030:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b7704183800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779190.380071:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773f4f4000 x1877767663820288/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779190.380100:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779190.380104:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790779190.380121:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b773b543800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779190.380125:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1790779190.380128:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790779190.380134:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b773b543800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779190.380150:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773f4f5f80 x1877767663820416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779190.380159:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779190.380162:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790779190.380164:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779190.380167:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1790779190.380169:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790779190.380174:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b7704186000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779190.380185:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773f4f7100 x1877767663820544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779190.380250:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663820288:0@lo:38:kworker.0 00000100:00100000:2.0:1790779190.380321:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779190.380376:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663820416:0@lo:8:kworker.0 00000400:00000100:2.0:1790779190.380408:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663820416 offset 0 length 520: 4 00000100:00100000:2.0:1790779190.380427:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663820544:0@lo:8:kworker.0 00000400:00000100:2.0:1790779190.380444:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663820544 offset 0 length 520: 4 00000100:00100000:1.0:1790779190.380648:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663820288 00000100:00100000:1.0:1790779190.380656:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663820288 00000100:00100000:1.0:1790779190.380698:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790779190.380706:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663820288:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790779190.380724:0:17151:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790779190.385014:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663820672:0@lo:400:kworker.0 00000100:00100000:0.0:1790779190.385103:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779190.385159:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f89954ec-b1b4-4b66-a198-81b81a38f825:3652:1877767663820160:0@lo:400:kworker.0 00000100:00100000:0.0:1790779190.385198:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779190.385258:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663820160 00000100:00100000:0.0:1790779190.385267:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663820160 00000100:00100000:0.0:1790779190.385338:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790779190.385347:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+12:3652:x1877767663820160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779190.385414:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+12:3652:x1877767663820160:12345-0@lo:400:kworker.0 Request processed in 68us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779190.385422:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790779190.385469:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f89954ec-b1b4-4b66-a198-81b81a38f825:3652:1877767663820160:0@lo:400:kworker.0 00000100:00100000:2.0:1790779190.385573:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663820672 00000100:00100000:2.0:1790779190.385582:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663820672 00000100:00100000:2.0:1790779190.385621:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779190.385628:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663820672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779190.385676:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663820672:12345-0@lo:400:kworker.0 Request processed in 48us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779190.385682:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790779190.385718:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b773f4f7b80 x1877767663820672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779190.385731:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663820672:0@lo:400:kworker.0 00000100:00100000:0.0:1790779190.409735:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663820288:12345-0@lo:38:kworker.0 Request processed in 29020us (29404us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790779190.409750:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790779190.410001:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779190.410008:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790779190.410012:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663820288:0@lo:38:kworker.0 00010000:00010000:3.0:1790779190.827716:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779191.272001:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790779191.849442:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779192.296448:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790779192.873293:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779193.319964:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00000040:00080000:1.0:1790779193.323673:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790779193.907542:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779194.343978:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00010000:00010000:2.0:1790779194.921196:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779195.368020:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00000100:00080000:0.0:1790779195.502678:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790779195.502686:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790779195.502690:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779195.502699:0:9333:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:0.0:1790779195.502706:0:9333:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790779195.502717:0:9333:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b7704183800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779195.502743:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b76046cd180 x1877767663820928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790779195.502759:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779195.502763:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790779195.502766:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779195.502769:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790779195.503054:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663820800:0@lo:400:kworker.0 00000100:00100000:3.0:1790779195.503128:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779195.503192:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779195.503199:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663821056:0@lo:400:kworker.0 00000100:00100000:0.0:1790779195.503226:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663820800 00000100:00100000:3.0:1790779195.503231:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779195.503251:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663820800 00000100:00100000:3.0:1790779195.503285:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663820928:0@lo:38:kworker.0 00000100:00100000:0.0:1790779195.503303:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790779195.503313:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+12:3649:x1877767663820800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779195.503378:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+12:3649:x1877767663820800:12345-0@lo:400:kworker.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779195.503385:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790779195.503556:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779195.503646:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663821056 00000100:00100000:3.0:1790779195.503651:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663821056 00000100:00100000:3.0:1790779195.503690:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790779195.503704:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663821056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779195.503738:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663821056:12345-0@lo:400:kworker.0 Request processed in 36us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779195.503745:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790779195.503776:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b76046ce680 x1877767663821056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779195.503789:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663821056:0@lo:400:kworker.0 00000100:00100000:3.0:1790779195.503799:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663820800:0@lo:400:kworker.0 00000100:00100000:0.0:1790779195.506083:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663820928 00000100:00100000:0.0:1790779195.506097:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663820928 00000100:00100000:3.0:1790779195.506217:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790779195.506225:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663820928:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790779195.506246:0:17152:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790779195.539582:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663820928:12345-0@lo:38:kworker.0 Request processed in 33345us (36014us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790779195.539598:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1790779195.539710:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779195.539717:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790779195.539722:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663820928:0@lo:38:kworker.0 00010000:00010000:3.0:1790779195.944106:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790779196.207667:0:17878:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790779196.207671:0:17878:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790779196.207673:0:17878:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1790779196.207824:0:17878:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b7703509000 00000020:01000004:3.0:1790779196.207854:0:17878:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1790779196.207867:0:17878:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790779196.207921:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9b773059b380) 00000020:00000080:3.0:1790779196.207940:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790779196.265696:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790779196.266374:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.269374:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.269602:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.269778:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.270120:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.270522:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.270672:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.270829:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.271214:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.271446:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.271603:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.271791:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.272109:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.272372:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.272557:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.272746:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.273072:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.273386:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.273572:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.273762:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.274062:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.274245:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.274500:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.274666:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.274831:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.275272:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.277294:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.278693:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.279161:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.279387:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.279590:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1790779196.279790:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.280280:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1790779196.284822:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790779196.286996:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1790779196.287511:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1790779196.287764:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1790779196.288102:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1790779196.288521:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1790779196.288796:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1790779196.289317:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1790779196.289547:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1790779196.290637:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1790779196.291088:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1790779196.291320:0:17878:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:3.0:1790779196.292000:0:17878:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790779196.292197:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1790779196.292207:0:17878:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790779196.292217:0:17878:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936dd61 00000020:01000004:3.0:1790779196.292223:0:17878:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790779196.292243:0:17878:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790779196.292246:0:17878:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790779196.292252:0:17878:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1790779196.292276:0:17878:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1790779196.292280:0:17878:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1790779196.305486:0:17878:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790779196.305538:0:17878:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1790779196.305542:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790779196.305543:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790779196.305545:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779196.305546:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779196.305547:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779196.305548:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779196.305549:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779196.305551:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779196.305552:0:17878:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790779196.305556:0:17878:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1790779196.305558:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790779196.305559:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790779196.305560:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779196.305561:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779196.305562:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779196.305563:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779196.305564:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779196.305565:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779196.305566:0:17878:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790779196.305595:0:17878:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790779196.305614:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821184:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790779196.305680:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779196.305768:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790779196.307749:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663821184 00000100:00100000:3.0:1790779196.307777:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663821184 00000100:00100000:3.0:1790779196.307851:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790779196.307861:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17878:x1877767663821184:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790779196.307925:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790779196.307929:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1790779196.307937:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1790779196.308756:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17878:x1877767663821184:12345-0@lo:253:mount.lustre.0 Request processed in 894us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.308766:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790779196.308854:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821184:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790779196.308908:0:17878:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790779196.308912:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790779196.308914:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790779196.308915:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779196.308916:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779196.308917:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779196.308918:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779196.308919:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779196.308921:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779196.308922:0:17878:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790779196.308941:0:17878:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b7703509000 from lustre-MDT0001 10000000:01000000:0.0:1790779196.308989:0:17878:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1790779196.308992:0:17878:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790779196.308999:0:17878:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b773b784d40 local copy 00010000:00010000:0.0:1790779196.309009:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779196.309116:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779196.309151:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779196.309182:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.309511:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663821312 00000100:00100000:2.0:1790779196.309516:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663821312 00000100:00100000:2.0:1790779196.309554:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790779196.309562:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17878:x1877767663821312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779196.309633:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17878:x1877767663821312:12345-0@lo:501:mount.lustre.0 Request processed in 72us (482us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790779196.309649:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790779196.309726:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821312:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790779196.309739:0:17878:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790779196.309758:0:17878:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790779196.309764:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.309773:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779196.309798:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b7703509000 10000000:01000000:1.0:1790779196.309803:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790779196.309808:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b773b784d40 10000000:01000000:1.0:1790779196.309810:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790779196.309814:0:17878:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b773b784d40 from 1 10000000:01000000:1.0:1790779196.309817:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790779196.309840:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936dd68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.309848:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936dd68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.309856:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936dd68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779196.309869:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779196.309923:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779196.309961:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603477e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.310213:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663821440 00000100:00100000:2.0:1790779196.310217:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663821440 00000100:00100000:2.0:1790779196.310245:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790779196.310251:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+12:17878:x1877767663821440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779196.310260:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779196.310271:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2600/0xb1aa4014e936dd6f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936dd68 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.310288:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2600/0xb1aa4014e936dd6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936dd68 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.310297:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2600/0xb1aa4014e936dd6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dd68 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.310305:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2600, rc 0) 00000100:00100000:2.0:1790779196.310359:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+13:17878:x1877767663821440:12345-0@lo:101:mount.lustre.0 Request processed in 106us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.310364:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790779196.310627:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779196.310640:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936dd68 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd6f expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.310649:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936dd68 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dd6f expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779196.310662:0:17878:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790779196.310677:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936dd68 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd6f expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.310684:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936dd68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd6f expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779196.310692:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b7703509000 10000000:01000000:1.0:1790779196.310696:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790779196.310700:0:17878:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b7703509000 from 1 10000000:01000000:1.0:1790779196.310702:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790779196.310715:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.310721:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.310728:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779196.310740:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779196.310772:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779196.310797:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603477e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.310859:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663821568 00000100:00100000:2.0:1790779196.310864:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663821568 00000100:00100000:2.0:1790779196.310903:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790779196.310911:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+13:17878:x1877767663821568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779196.310918:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779196.310926:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2e00/0xb1aa4014e936dd7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936dd76 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.310939:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2e00/0xb1aa4014e936dd7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936dd76 expref: 14 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.311200:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2e00/0xb1aa4014e936dd7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dd76 expref: 14 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.311207:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2e00, rc 0) 00000100:00100000:2.0:1790779196.311242:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+14:17878:x1877767663821568:12345-0@lo:101:mount.lustre.0 Request processed in 333us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.311247:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790779196.311350:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779196.311362:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.311370:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779196.311382:0:17878:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790779196.311385:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.311392:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779196.311399:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1790779196.311403:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790779196.311407:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b7703509000 10000000:01000000:1.0:1790779196.311410:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790779196.311412:0:17878:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1790779196.311414:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790779196.311428:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.311435:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.311442:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779196.311460:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779196.311485:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779196.311511:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603477e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.311671:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663821696 00000100:00100000:2.0:1790779196.311675:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663821696 00000100:00100000:2.0:1790779196.311701:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790779196.311707:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+14:17878:x1877767663821696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779196.311715:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779196.311724:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a3000/0xb1aa4014e936dd8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936dd84 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.311737:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3000/0xb1aa4014e936dd8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936dd84 expref: 15 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.311746:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a3000/0xb1aa4014e936dd8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dd84 expref: 15 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.311753:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3000, rc 0) 00000100:00100000:2.0:1790779196.311785:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+15:17878:x1877767663821696:12345-0@lo:101:mount.lustre.0 Request processed in 79us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.311791:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790779196.312172:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779196.312185:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.312193:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779196.316241:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1790779196.317792:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779196.324221:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790779196.324281:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1790779196.324296:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1790779196.324311:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1790779196.324324:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1790779196.324351:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1790779196.324368:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1790779196.324380:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1790779196.324392:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1790779196.324405:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1790779196.324420:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1790779196.324433:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1790779196.324445:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1790779196.324458:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1790779196.324473:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1790779196.324486:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1790779196.324498:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1790779196.324524:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1790779196.324537:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1790779196.324548:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1790779196.324562:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1790779196.324575:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1790779196.324605:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1790779196.324637:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1790779196.324643:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1790779196.324765:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779196.324830:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.324967:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663821824 00000100:00100000:2.0:1790779196.324975:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663821824 00000100:00100000:2.0:1790779196.325046:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790779196.325056:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+15:17878:x1877767663821824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779196.325152:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603477480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.325203:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+15:17878:x1877767663821824:12345-0@lo:501:mount.lustre.0 Request processed in 146us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.325212:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790779196.325763:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779196.325801:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779196.326116:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779196.326182:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603477480 going to sleep for 11 seconds 00000100:00100000:3.0:1790779196.326217:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663821952 00000100:00100000:3.0:1790779196.326223:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663821952 00000100:00100000:3.0:1790779196.326264:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790779196.326272:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+15:17878:x1877767663821952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779196.327555:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+15:17878:x1877767663821952:12345-0@lo:503:mount.lustre.0 Request processed in 1277us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779196.327569:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790779196.327673:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663821952:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790779196.328723:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790779196.328809:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663822080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779196.328907:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779196.329230:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603477e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790779196.329532:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663822080 00000100:00100000:3.0:1790779196.329539:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663822080 00000100:00100000:2.0:1790779196.329706:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790779196.329715:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+15:17878:x1877767663822080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779196.332664:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+15:17878:x1877767663822080:12345-0@lo:502:mount.lustre.0 Request processed in 2942us (3749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.332676:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790779196.332787:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663822080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790779196.333067:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790779196.333098:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1790779196.333111:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1790779196.333123:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1790779196.333137:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1790779196.333151:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1790779196.333176:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1790779196.333190:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1790779196.333202:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1790779196.333212:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1790779196.333226:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1790779196.333238:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1790779196.333268:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1790779196.333284:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1790779196.333296:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1790779196.333640:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1790779196.333663:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1790779196.333676:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1790779196.333688:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1790779196.333702:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1790779196.333714:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1790779196.333726:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1790779196.333737:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1790779196.333747:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1790779196.333757:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1790779196.333766:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1790779196.333776:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1790779196.333786:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1790779196.333810:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1790779196.333822:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1790779196.333845:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1790779196.333860:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1790779196.333872:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1790779196.333913:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1790779196.333927:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1790779196.333950:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1790779196.333974:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1790779196.333990:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1790779196.334004:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1790779196.334028:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1790779196.334040:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1790779196.334053:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1790779196.334066:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1790779196.334078:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1790779196.334129:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663822208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779196.334189:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779196.334497:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603477e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790779196.334741:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663822208 00000100:00100000:3.0:1790779196.334749:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663822208 00000100:00100000:3.0:1790779196.334845:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790779196.334854:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+15:17878:x1877767663822208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779196.335153:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+15:17878:x1877767663822208:12345-0@lo:502:mount.lustre.0 Request processed in 300us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779196.335160:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790779196.335277:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663822208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790779196.335357:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1790779196.335368:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1790779196.335801:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779196.335811:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779196.335814:0:17882:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1790779196.335819:0:17882:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1790779196.335821:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779196.336263:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9b77340fb380) 00000020:00000080:1.0:1790779196.336286:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1790779196.336294:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790779196.336382:0:17882:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790779196.336389:0:17882:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936dd99 00000020:00000080:1.0:1790779196.336577:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1790779196.336582:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779196.336585:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779196.336586:0:17882:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1790779196.336589:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779196.336592:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779196.336594:0:17882:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1790779196.336597:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779196.336604:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9b77340f99c0) 00000020:00000080:1.0:1790779196.336613:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1790779196.336626:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790779196.336628:0:17882:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1790779196.336631:0:17882:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1790779196.336636:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790779196.336677:0:17882:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b7703509000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1790779196.336687:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9b77340f8000) 00000020:00000080:1.0:1790779196.336694:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1790779196.336757:0:17882:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790779196.336761:0:17882:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936ddae 00000020:00000080:1.0:1790779196.337439:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1790779196.337469:0:17882:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790779196.337476:0:17882:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb1aa4014e936ddb5 00080000:01000000:1.0:1790779196.337483:0:17882:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790779196.337485:0:17882:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936ddbc 00000100:00100000:1.0:1790779196.399989:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790779196.426076:0:17882:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1790779196.426507:0:17882:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1790779196.426770:0:17882:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790779196.430639:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1790779196.430667:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779196.430674:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.430676:0:17882:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1790779196.430680:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779196.430685:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.430687:0:17882:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1790779196.430697:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790779196.430703:0:17882:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:0.0:1790779196.430733:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790779196.430750:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9b7603224d40) 00000020:00000080:0.0:1790779196.430771:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1790779196.430783:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790779196.430861:0:17882:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1790779196.430868:0:17882:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790779196.430875:0:17882:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936ddca 00010000:00080000:0.0:1790779196.430953:0:17882:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b771828f800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1790779196.433584:0:17882:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1790779196.435646:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790779196.435661:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1790779196.435701:0:17882:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790779196.435722:0:17882:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936ddd1 00000100:00080000:0.0:1790779196.435732:0:17882:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790779196.435743:0:17882:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b771828f800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779196.435775:0:17882:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b76046ce300 x1877767663822336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790779196.435807:0:17882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1790779196.435870:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779196.435874:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.435876:0:17882:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1790779196.435902:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790779196.435905:0:17882:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1790779196.435907:0:17882:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790779196.435909:0:17882:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790779196.435910:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790779196.435913:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.435914:0:17882:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790779196.435916:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779196.435921:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.435922:0:17882:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1790779196.435926:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790779196.436082:0:17882:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790779196.436098:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779196.436107:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.436108:0:17882:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1790779196.436111:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790779196.436113:0:17882:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1790779196.436115:0:17882:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790779196.436116:0:17882:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790779196.436118:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790779196.436120:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.436121:0:17882:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790779196.436123:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790779196.436126:0:17882:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790779196.436130:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.436131:0:17882:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790779196.436133:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790779196.436137:0:17882:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:0.0:1790779196.436154:0:17882:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790779196.436156:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790779196.436170:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9b7603220000) 00000020:00000080:0.0:1790779196.436181:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1790779196.436185:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790779196.436253:0:17882:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1790779196.436259:0:17882:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790779196.436266:0:17882:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936dddf 00010000:00080000:0.0:1790779196.436304:0:17882:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7711492000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1790779196.436511:0:17882:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1790779196.437126:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790779196.437132:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790779196.437135:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779196.437142:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:2.0:1790779196.437146:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1790779196.437156:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b7704183800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779196.437183:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b760300aa00 x1877767663822464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779196.437196:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779196.437200:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779196.437202:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779196.437205:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790779196.437250:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779196.437265:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663822592:0@lo:400:kworker.0 00000100:00100000:2.0:1790779196.437352:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.437430:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663822592 00000100:00100000:2.0:1790779196.437438:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663822592 00000100:00100000:2.0:1790779196.437487:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779196.437497:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663822592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779196.437551:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663822592:12345-0@lo:400:kworker.0 Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.437558:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790779196.437599:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b7603009880 x1877767663822592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779196.437612:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663822592:0@lo:400:kworker.0 00000100:00100000:3.0:1790779196.438153:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663822336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790779196.438215:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779196.438259:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663822464:0@lo:38:kworker.0 00000100:00100000:3.0:1790779196.438283:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779196.438316:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663822336 00000100:00100000:3.0:1790779196.438320:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663822336 00000100:00100000:3.0:1790779196.438345:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663822464 00000100:00100000:3.0:1790779196.438348:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663822464 00000100:00100000:3.0:1790779196.438360:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790779196.438365:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663822336:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790779196.438387:0:17152:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1790779196.438432:0:17152:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936dde6 00000004:00100000:3.0:1790779196.438449:0:17152:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790779196.438455:0:17152:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:0.0:1790779196.441163:0:17882:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790779196.441687:0:17882:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1790779196.444917:0:17152:0:(import.c:65:import_set_state_nolock()) ffff9b774129d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779196.445020:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1877767663822336:12345-0@lo:38:llog_process_th.0 Request processed in 6651us (6802us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779196.445029:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790779196.445055:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779196.445061:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663822464:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1790779196.445100:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663822464:12345-0@lo:38:kworker.0 Request processed in 39us (6815us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790779196.445106:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790779196.446424:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790779196.446439:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1790779196.446447:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1790779196.446454:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790779196.446457:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b771828f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790779196.446481:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663822336:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790779196.446503:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790779196.446507:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779196.446510:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790779196.446513:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663822464:0@lo:38:kworker.0 00000100:00100000:1.0:1790779196.447116:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779196.447132:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663822720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779196.447185:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.447262:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663822720 00000100:00100000:2.0:1790779196.447268:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663822720 00000100:00100000:2.0:1790779196.447304:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790779196.447321:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1877767663822720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779196.447356:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790779196.447400:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1877767663822720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.447406:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790779196.447599:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663822720:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1790779196.447792:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790779196.448230:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1790779196.448398:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1790779196.449179:0:17887:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790779196.449184:0:17887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790779196.450797:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790779196.450808:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790779196.450847:0:17882:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790779196.450867:0:17882:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936dded 00000100:00080000:2.0:1790779196.451213:0:17882:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790779196.451234:0:17882:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b7711492000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779196.451273:0:17882:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b760300ad80 x1877767663822848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779196.451348:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663822848:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790779196.451401:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663822848 offset 0 length 520: 4 00000100:00080000:2.0:1790779196.451458:0:17882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790779196.451521:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779196.451525:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779196.451527:0:17882:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790779196.451529:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790779196.451532:0:17882:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1790779196.451533:0:17882:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790779196.451535:0:17882:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790779196.451536:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790779196.451538:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779196.451540:0:17882:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790779196.451542:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790779196.451546:0:17882:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790779196.451549:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779196.451551:0:17882:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790779196.451554:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790779196.451557:0:17882:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:2.0:1790779196.451576:0:17882:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790779196.451579:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790779196.451593:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9b77340999c0) 00000020:00000080:2.0:1790779196.451617:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1790779196.451623:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790779196.451683:0:17882:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1790779196.451689:0:17882:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790779196.451695:0:17882:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936ddfb 00010000:00080000:2.0:1790779196.451722:0:17882:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7734583000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1790779196.451974:0:17882:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1790779196.452051:0:17882:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790779196.452074:0:17882:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1790779196.453001:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779196.453006:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790779196.453014:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779196.453017:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1790779196.454273:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790779196.455075:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1790779196.455237:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790779196.462568:0:17889:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790779196.462578:0:17889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790779196.463573:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790779196.463586:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790779196.463699:0:17882:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790779196.463719:0:17882:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936de02 00000100:00080000:2.0:1790779196.463729:0:17882:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790779196.463740:0:17882:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b7734583000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779196.463776:0:17882:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603008700 x1877767663822976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779196.463837:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663822976:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790779196.463932:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663822976 offset 0 length 520: 4 00000100:00080000:2.0:1790779196.464215:0:17882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790779196.464316:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779196.464320:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779196.464322:0:17882:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790779196.464324:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779196.464328:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779196.464329:0:17882:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790779196.464331:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790779196.464333:0:17882:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790779196.464344:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779196.464347:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779196.464348:0:17882:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790779196.464350:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779196.464353:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779196.464354:0:17882:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790779196.464357:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790779196.464380:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779196.464383:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779196.464384:0:17882:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790779196.464386:0:17882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1790779196.466835:0:17878:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 00000100:00080000:0.0:1790779196.467112:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779196.467117:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790779196.467119:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779196.467122:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 10000000:01000000:1.0:1790779196.467180:0:17878:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1790779196.467198:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.467211:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779196.467219:0:17878:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7703509000 from 1 10000000:01000000:1.0:1790779196.467222:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790779196.467264:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.467272:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.467284:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779196.467483:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779196.467547:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779196.467627:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603477180 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.467717:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663823104 00000100:00100000:2.0:1790779196.467737:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663823104 00000100:00100000:2.0:1790779196.467833:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790779196.467844:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+15:17878:x1877767663823104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779196.467858:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779196.467899:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936de10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936de09 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.467925:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936de10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936de09 expref: 16 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.467936:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936de10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de09 expref: 16 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.467952:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2800, rc 0) 00000100:00100000:2.0:1790779196.468268:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+16:17878:x1877767663823104:12345-0@lo:101:mount.lustre.0 Request processed in 425us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.468275:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790779196.468364:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779196.468389:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779196.468399:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779196.469302:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823232:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1790779196.469572:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779196.473393:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603477180 going to sleep for 11 seconds 00000100:00100000:3.0:1790779196.473613:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663823232 00000100:00100000:3.0:1790779196.473628:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663823232 00000100:00100000:3.0:1790779196.473692:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790779196.473702:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+16:17878:x1877767663823232:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1790779196.473735:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790779196.474467:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790779196.474480:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1790779196.474630:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+16:17878:x1877767663823232:12345-0@lo:256:mount.lustre.0 Request processed in 928us (5056us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779196.474639:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790779196.474747:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823232:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790779196.475469:0:17878:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790779196.475491:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779196.475505:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779196.475515:0:17878:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7703509000 from 1 10000000:01000000:0.0:1790779196.475518:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790779196.475551:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779196.475560:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779196.475569:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779196.475596:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790779196.475721:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779196.475761:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773426dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779196.475919:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663823360 00000100:00100000:3.0:1790779196.475927:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663823360 00000100:00100000:3.0:1790779196.475967:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790779196.475976:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+16:17878:x1877767663823360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779196.475988:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779196.476002:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701662000/0xb1aa4014e936de1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936de17 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779196.476025:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701662000/0xb1aa4014e936de1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936de17 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779196.476035:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701662000/0xb1aa4014e936de1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de17 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779196.476043:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662000, rc 0) 00000100:00100000:3.0:1790779196.476082:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17878:x1877767663823360:12345-0@lo:101:mount.lustre.0 Request processed in 107us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779196.476088:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790779196.476188:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779196.476202:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779196.476210:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790779196.476475:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790779196.476507:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779196.476534:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779196.476558:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773426d300 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.476593:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663823488 00000100:00100000:2.0:1790779196.476603:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663823488 00000100:00100000:2.0:1790779196.476641:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790779196.476649:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17878:x1877767663823488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779196.476785:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779196.476812:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779196.476828:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17878:x1877767663823488:12345-0@lo:501:mount.lustre.0 Request processed in 108us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.476837:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790779196.476858:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779196.476956:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773426d300 going to sleep for 11 seconds 00000100:00100000:3.0:1790779196.480272:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663823616 00000100:00100000:3.0:1790779196.480286:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663823616 00000100:00100000:3.0:1790779196.480501:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790779196.480511:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17878:x1877767663823616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779196.480703:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17878:x1877767663823616:12345-0@lo:503:mount.lustre.0 Request processed in 194us (3846us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779196.480721:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790779196.480827:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790779196.481252:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790779196.481361:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779196.481410:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779196.486830:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773426dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779196.488735:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663823744 00000100:00100000:1.0:1790779196.488750:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663823744 00000100:00100000:0.0:1790779196.488923:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790779196.488947:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17878:x1877767663823744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779196.489142:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17878:x1877767663823744:12345-0@lo:502:mount.lustre.0 Request processed in 198us (7732us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779196.489151:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790779196.490384:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790779196.490685:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1790779196.490721:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1790779196.490739:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1790779196.490752:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1790779196.490764:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1790779196.490776:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1790779196.490787:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1790779196.490798:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1790779196.490809:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1790779196.490821:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1790779196.490834:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1790779196.490874:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779196.490985:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779196.491026:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603477e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790779196.491180:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663823872 00000100:00100000:0.0:1790779196.491188:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663823872 00000100:00100000:0.0:1790779196.491225:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790779196.491234:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17878:x1877767663823872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779196.491334:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17878:x1877767663823872:12345-0@lo:502:mount.lustre.0 Request processed in 101us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779196.491352:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790779196.491520:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663823872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790779196.491568:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1790779196.491582:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790779196.493543:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779196.493557:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.493559:0:17891:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790779196.493568:0:17891:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b7703509000 00000020:00000080:0.0:1790779196.493571:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790779196.493579:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779196.493582:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.493584:0:17891:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790779196.493586:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779196.493589:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.493590:0:17891:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790779196.493593:0:17891:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b7703509000 00000020:00000080:0.0:1790779196.493595:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790779196.493788:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779196.493792:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.493793:0:17891:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790779196.493796:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779196.493798:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.493799:0:17891:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790779196.493815:0:17891:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b7703509000 00000020:00000080:0.0:1790779196.493817:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790779196.494135:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779196.494139:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.494141:0:17891:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790779196.494144:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779196.494147:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.494148:0:17891:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790779196.494153:0:17891:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b7703509000 00000020:00000080:0.0:1790779196.494154:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790779196.494181:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779196.494185:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779196.494186:0:17891:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790779196.494189:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1790779196.494753:0:17878:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1790779196.494784:0:17878:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790779196.494806:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.494830:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779196.495062:0:17878:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790779196.495065:0:17878:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b7703509000 10000000:01000000:2.0:1790779196.495068:0:17878:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b7703509000 10000000:01000000:2.0:1790779196.495074:0:17878:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790779196.495080:0:17878:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b7703509000 from 1 10000000:01000000:2.0:1790779196.495085:0:17878:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790779196.495120:0:17878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.495128:0:17878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.495139:0:17878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779196.495162:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779196.495229:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.495272:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77124be180 going to sleep for 11 seconds 00000100:00100000:0.0:1790779196.495696:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663824000 00000100:00100000:0.0:1790779196.495704:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663824000 00000100:00100000:0.0:1790779196.495787:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790779196.495796:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17878:x1877767663824000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779196.495810:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779196.495822:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769200/0xb1aa4014e936de2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936de25 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779196.495845:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769200/0xb1aa4014e936de2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936de25 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779196.495856:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769200/0xb1aa4014e936de2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de25 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779196.495864:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769200, rc 0) 00000100:00100000:0.0:1790779196.495930:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824000:12345-0@lo:101:mount.lustre.0 Request processed in 135us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779196.495945:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790779196.496035:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779196.496049:0:17878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.496059:0:17878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779196.502707:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790779196.503213:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790779196.508151:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1790779196.508211:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1790779196.508226:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1790779196.508240:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1790779196.508254:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1790779196.508267:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1790779196.508280:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1790779196.508292:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1790779196.508306:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1790779196.508321:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1790779196.508333:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1790779196.508375:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1790779196.508391:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1790779196.508404:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1790779196.508416:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1790779196.508429:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1790779196.508442:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1790779196.508456:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1790779196.508469:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1790779196.508482:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1790779196.508496:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1790779196.508510:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1790779196.508523:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1790779196.508537:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1790779196.508551:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1790779196.508564:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1790779196.508576:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1790779196.508604:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1790779196.508631:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1790779196.508644:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1790779196.508752:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779196.508816:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.508861:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77124be900 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.509237:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663824128 00000100:00100000:2.0:1790779196.509246:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663824128 00000100:00100000:2.0:1790779196.509297:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790779196.509307:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779196.509450:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824128:12345-0@lo:501:mount.lustre.0 Request processed in 145us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.509459:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790779196.509508:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779196.509539:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779196.509580:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.509618:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77124be900 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.509632:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663824256 00000100:00100000:2.0:1790779196.509635:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663824256 00000100:00100000:2.0:1790779196.509654:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790779196.509659:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779196.509727:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824256:12345-0@lo:503:mount.lustre.0 Request processed in 67us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.509734:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790779196.509774:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790779196.510467:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790779196.510530:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779196.510581:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.510716:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77124be180 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.510738:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663824384 00000100:00100000:2.0:1790779196.510743:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663824384 00000100:00100000:2.0:1790779196.510772:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790779196.510778:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779196.510858:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824384:12345-0@lo:502:mount.lustre.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.510865:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790779196.510936:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790779196.511229:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1790779196.511251:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1790779196.511262:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1790779196.511275:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1790779196.511289:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1790779196.511301:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1790779196.511745:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1790779196.511760:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1790779196.511774:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1790779196.511788:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1790779196.511801:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1790779196.511815:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1790779196.511845:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1790779196.511862:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1790779196.511874:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1790779196.511911:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1790779196.511925:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1790779196.511937:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1790779196.511952:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1790779196.513782:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1790779196.513798:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1790779196.513811:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1790779196.513824:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1790779196.513842:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1790779196.513857:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1790779196.513870:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1790779196.513900:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1790779196.513915:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1790779196.513944:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1790779196.514788:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1790779196.514820:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1790779196.514835:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1790779196.514849:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1790779196.514860:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1790779196.514873:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1790779196.515433:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1790779196.515451:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1790779196.515466:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1790779196.515478:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1790779196.515490:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1790779196.515502:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1790779196.515514:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1790779196.515526:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1790779196.515540:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1790779196.515570:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1790779196.515588:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1790779196.516456:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1790779196.516506:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1790779196.516566:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779196.517208:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.517246:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77124be180 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.517290:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663824512 00000100:00100000:2.0:1790779196.517297:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663824512 00000100:00100000:2.0:1790779196.518055:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790779196.518065:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779196.518193:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824512:12345-0@lo:502:mount.lustre.0 Request processed in 130us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.518202:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790779196.518275:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790779196.520911:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1790779196.520945:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1790779196.520993:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779196.521065:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.529484:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77124be180 going to sleep for 11 seconds 00000100:00100000:1.0:1790779196.529559:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663824640 00000100:00100000:1.0:1790779196.529568:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663824640 00000100:00100000:1.0:1790779196.529698:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790779196.529707:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779196.530196:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824640:12345-0@lo:502:mount.lustre.0 Request processed in 488us (9129us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779196.530204:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790779196.532475:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779196.532580:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1790779196.532600:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1790779196.546153:0:17897:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1790779196.546172:0:17897:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9b773409b380) 00000020:00000080:2.0:1790779196.546197:0:17897:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1790779196.546299:0:17897:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b7703509000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1790779196.546978:0:17897:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b7703509000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1790779196.546984:0:17897:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b7703509000 3 00010000:00080000:2.0:1790779196.547035:0:17897:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7603229800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1790779196.549160:0:17897:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1790779196.549378:0:17897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1790779196.549423:0:17897:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790779196.549439:0:17897:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb1aa4014e936de3a 00000100:00080000:2.0:1790779196.549452:0:17897:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790779196.549465:0:17897:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b7603229800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779196.549506:0:17897:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603009f80 x1877767663824768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779196.549547:0:17897:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790779196.549581:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779196.549586:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779196.549588:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779196.549591:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790779196.549920:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877767663824768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790779196.549985:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.551921:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663824768 00000100:00100000:2.0:1790779196.551933:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663824768 00000100:00100000:2.0:1790779196.551974:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779196.551982:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663824768:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790779196.552008:0:17146:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:2.0:1790779196.552054:0:17146:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb1aa4014e936de41 00000004:00100000:2.0:1790779196.552068:0:17146:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790779196.552097:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9b7711bf2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779196.552166:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877767663824768:12345-0@lo:38:llog_process_th.0 Request processed in 184us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.552173:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790779196.552218:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b7603009f80 x1877767663824768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779196.552228:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790779196.552235:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1790779196.552242:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790779196.552246:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790779196.552248:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7603229800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790779196.552254:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877767663824768:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790779196.554249:0:17897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1790779196.554444:0:17878:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790779196.554475:0:17878:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790779196.554492:0:17878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779196.554503:0:17878:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790779196.554551:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790779196.554554:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790779196.554555:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779196.554556:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779196.554557:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779196.554559:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779196.554560:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779196.554562:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779196.554564:0:17878:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790779196.554567:0:17878:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1790779196.554569:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790779196.554571:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790779196.554572:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779196.554573:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779196.554574:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779196.554575:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779196.554576:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779196.554577:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779196.554578:0:17878:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790779196.554613:0:17878:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790779196.554631:0:17878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790779196.554696:0:17878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779196.554733:0:17878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773426dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.554839:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663824896 00000100:00100000:2.0:1790779196.554847:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663824896 00000100:00100000:2.0:1790779196.554916:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790779196.554925:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17878:x1877767663824896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790779196.554951:0:17141:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790779196.554965:0:17141:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1790779196.556025:0:17126:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1790779196.556052:0:17141:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790779196.556062:0:17141:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1790779196.556191:0:17162:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790779196.556196:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790779196.556215:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.556230:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936dd4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dd45 expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.556237:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936de10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de09 expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.556244:0:17162:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.556273:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936de10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936de09 expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.556287:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936de10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936de09 expref: 18 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779196.556300:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663825024:0@lo:104: 00000100:00100000:2.0:1790779196.556736:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790779196.556771:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936dd4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936dd45 expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.556779:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936dd4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936dd45 expref: 18 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779196.556786:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663825152:0@lo:104: 00000100:00100000:2.0:1790779196.556805:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.556818:0:17162:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77124bea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.556850:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663825024 00000100:00100000:2.0:1790779196.556856:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663825024 00000100:00100000:2.0:1790779196.556899:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663825152 00000100:00100000:2.0:1790779196.556902:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663825152 00000100:00100000:2.0:1790779196.556916:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779196.556922:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+4:17162:x1877767663825024:12345-0@lo:104: 00010000:00010000:2.0:1790779196.556933:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.556977:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790779196.556982:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+4:17162:x1877767663825024:12345-0@lo:104: Request processed in 60us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.556988:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779196.557002:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779196.557007:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+3:17162:x1877767663825152:12345-0@lo:104: 00010000:00010000:2.0:1790779196.557015:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.557046:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790779196.557057:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+3:17162:x1877767663825152:12345-0@lo:104: Request processed in 49us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.557062:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790779196.557081:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779196.557087:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.557094:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7e00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779196.557097:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.557105:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779196.557112:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779196.557117:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790779196.557144:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.557150:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779196.557169:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.557176:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936de09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de10 expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.557187:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779196.557189:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.557205:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768e00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779196.557207:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.557213:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779196.557219:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779196.557223:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790779196.557235:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.557241:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779196.557246:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.557252:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936dd45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936dd4c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.557263:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779196.557264:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779196.557266:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779196.557271:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779196.557282:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663825280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779196.561057:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.561128:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779196.561141:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663825408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779196.561207:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779196.561253:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663825280 00000100:00100000:2.0:1790779196.561260:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663825280 00010000:00010000:2.0:1790779196.561292:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936de10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de09 expref: 19 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779196.561330:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663825408 00000100:00100000:2.0:1790779196.561343:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663825408 00010000:00010000:2.0:1790779196.561356:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936dd4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936dd45 expref: 20 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779196.561370:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779196.561378:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+20:3649:x1877767663825280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779196.561390:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779196.561395:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936de10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de09 expref: 20 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.561405:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936de10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936de09 expref: 20 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.561423:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779196.561457:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+20:3649:x1877767663825280:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.561463:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779196.561479:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779196.561485:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+19:3649:x1877767663825408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779196.561495:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779196.561499:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936dd4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936dd45 expref: 19 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.561519:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936dd4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936dd45 expref: 19 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.561530:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.561538:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790779196.561553:0:17132:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010985934s 00010000:00010000:2.0:1790779196.561557:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.561563:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.561569:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.561575:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.561581:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779196.561585:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.561593:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.561601:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.562567:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779196.562680:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+19:3649:x1877767663825408:12345-0@lo:103:ldlm_bl.0 Request processed in 1192us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.562689:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790779196.562748:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936de10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936de09 expref: 18 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779196.562759:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663825024:0@lo:104: 00010000:00010000:2.0:1790779196.562769:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936dd4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936dd45 expref: 17 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779196.562776:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663825152:0@lo:104: 00010000:00010000:2.0:1790779196.562792:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.562800:0:17162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.562807:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779196.562812:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936de48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779196.562836:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663825408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779196.562844:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663825280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779196.562914:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+16:17878:x1877767663824896:12345-0@lo:253:mount.lustre.0 Request processed in 7990us (8216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.562929:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790779196.566783:0:17878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:17878:1877767663824896:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790779196.566814:0:17878:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790779196.566818:0:17878:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790779196.566819:0:17878:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790779196.566820:0:17878:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779196.566822:0:17878:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779196.566823:0:17878:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779196.566825:0:17878:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779196.566826:0:17878:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779196.566828:0:17878:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779196.566829:0:17878:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790779196.566843:0:17878:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1790779196.599986:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1790779196.600107:0:17902:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1790779196.600111:0:17902:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790779196.600426:0:17903:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1790779196.600850:0:17903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1790779196.602713:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1790779196.608724:0:17904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17904:1877767663825536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790779196.608807:0:17904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779196.608841:0:17904:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7701254d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.608980:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663825536 00000100:00100000:2.0:1790779196.608989:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663825536 00000100:00100000:2.0:1790779196.609037:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790779196.609044:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17904:x1877767663825536:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790779196.609120:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17904:x1877767663825536:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 76us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.609128:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:01000000:2.0:1790779196.609261:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1790779196.609323:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790779196.609758:0:17878:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790779196.609766:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1790779196.609807:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790779196.610820:0:17878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790779196.611465:0:17878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790779196.611502:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1790779196.611595:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790779196.612190:0:17878:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1790779196.612921:0:17903:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790779196.613029:0:17903:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1790779196.613382:0:17904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17904:1877767663825536:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1790779196.613422:0:17904:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790779196.613472:0:17904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17904:1877767663825664:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790779196.613537:0:17904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779196.613577:0:17904:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7701254c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790779196.613754:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663825664 00000100:00100000:3.0:1790779196.613762:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663825664 00000100:00100000:3.0:1790779196.613813:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790779196.613821:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17904:x1877767663825664:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790779196.619150:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17904:x1877767663825664:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 5317us (5601us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779196.619166:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790779196.620839:0:17904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17904:1877767663825664:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790779196.620965:0:17904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17904:1877767663825792:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1790779196.621025:0:17904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779196.621069:0:17904:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7701254d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.621245:0:17157:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663825792 00000100:00100000:2.0:1790779196.621253:0:17157:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663825792 00000100:00100000:2.0:1790779196.621303:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779196.621320:0:17157:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17904:x1877767663825792:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790779196.621382:0:17157:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17904:x1877767663825792:12345-0@lo:900:lod0001_rec0000.0 Request processed in 62us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.621390:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00000004:0.0:1790779196.626419:0:17878:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:0.0:1790779196.626542:0:17904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b76046cc700 x1877767663825792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790779212 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779196.626558:0:17904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17904:1877767663825792:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1790779196.628444:0:17904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17904:1877767663825920:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790779196.628516:0:17904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779196.628802:0:17904:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772fe83cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779196.634743:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663825920 00000100:00100000:2.0:1790779196.634758:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663825920 00000100:00100000:2.0:1790779196.634836:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790779196.634846:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17904:x1877767663825920:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790779196.635321:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17904:x1877767663825920:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 476us (6804us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779196.635330:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790779196.635616:0:17904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17904:1877767663825920:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1790779196.635678:0:17904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1790779196.638778:0:17878:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790779196.638815:0:17878:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbc92c556b988 00100000:10000000:1.0:1790779196.638824:0:17878:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:0.0:1790779196.639816:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790779196.639941:0:17904:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790779196.639946:0:17904:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:1.0:1790779196.647371:0:17878:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790779196.647411:0:17878:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790779196.647427:0:17878:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790779196.647455:0:17878:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1790779196.659944:0:17878:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779196.660459:0:17878:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790779196.968009:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779197.416290:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00000040:00080000:0.0:1790779197.608678:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1790779197.800056:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790779197.800064:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7703509000 from 8 10000000:01000000:0.0:1790779197.800069:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790779197.800122:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779197.800135:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779197.800146:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779197.800171:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663826048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779197.800249:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779197.800310:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779197.800426:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663826048 00000100:00100000:2.0:1790779197.800434:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663826048 00000100:00100000:2.0:1790779197.800489:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790779197.800498:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+16:17143:x1877767663826048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779197.800510:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779197.800523:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936de56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936de4f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.800546:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936de56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936de4f expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.800556:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936de56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de4f expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.800565:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3e00, rc 0) 00000100:00100000:2.0:1790779197.800616:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17143:x1877767663826048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779197.800623:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790779197.800704:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663826048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779197.800717:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779197.800725:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779197.800792:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663826176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790779197.800826:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779197.800849:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b2900 going to sleep for 11 seconds 00000100:00100000:2.0:1790779197.800923:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663826176 00000100:00100000:2.0:1790779197.800927:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663826176 00000100:00100000:2.0:1790779197.800947:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790779197.800953:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17143:x1877767663826176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790779197.800972:0:17141:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790779197.800986:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790779197.800989:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1790779197.801061:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17143:x1877767663826176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779197.801067:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790779197.801097:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663826176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790779197.801138:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790779197.801144:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.801152:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779197.801160:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790779197.801163:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7604541000 from 8 10000000:01000000:2.0:1790779197.801165:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790779197.801180:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.801187:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.801195:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779197.801207:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663826304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790779197.801231:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779197.801257:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b2900 going to sleep for 11 seconds 00000100:00100000:2.0:1790779197.801268:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663826304 00000100:00100000:2.0:1790779197.801271:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663826304 00000100:00100000:2.0:1790779197.801286:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790779197.801291:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17143:x1877767663826304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779197.801298:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779197.801305:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936de64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936de5d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.801318:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936de64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936de5d expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.801339:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936de64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de5d expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.801345:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2a00, rc 0) 00000100:00100000:2.0:1790779197.801372:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17143:x1877767663826304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779197.801378:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790779197.801405:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663826304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779197.801415:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.801421:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779197.801452:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663826432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790779197.801476:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779197.801496:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78240 going to sleep for 11 seconds 00000100:00100000:2.0:1790779197.801506:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663826432 00000100:00100000:2.0:1790779197.801509:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663826432 00000100:00100000:2.0:1790779197.801528:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790779197.801533:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17143:x1877767663826432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790779197.801543:0:17141:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790779197.801553:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790779197.801556:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1790779197.801612:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17143:x1877767663826432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 78us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779197.801619:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790779197.801645:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663826432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790779197.801673:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790779197.801679:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.801686:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779197.992507:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779198.440999:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00000040:00080000:0.0:1790779198.632845:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790779199.016063:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779199.464236:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00010000:00010000:2.0:1790779200.042990:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779200.488061:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790779201.070573:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779201.511950:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 0 seconds 00000100:00080000:2.0:1790779201.640069:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790779201.640075:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790779201.640079:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779201.640094:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b7704183800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779201.640127:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b760300b480 x1877767663826688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779201.640144:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779201.640148:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779201.640151:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779201.640154:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779201.640173:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779201.640176:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779201.640178:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779201.640181:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790779201.640293:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663826560:0@lo:400:kworker.0 00000100:00100000:2.0:1790779201.640364:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779201.640631:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779201.640638:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663826816:0@lo:400:kworker.0 00000100:00100000:2.0:1790779201.640664:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779201.640694:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663826688:0@lo:38:kworker.0 00000100:00100000:2.0:1790779201.640715:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779201.640738:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663826944:0@lo:400:kworker.0 00000100:00100000:2.0:1790779201.640760:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779201.640774:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779201.640778:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663827072:0@lo:400:kworker.0 00000100:00100000:2.0:1790779201.640793:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779201.640906:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663826560 00000100:00100000:2.0:1790779201.640921:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663826560 00000100:00100000:2.0:1790779201.640962:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790779201.640969:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:3651:x1877767663826560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779201.641153:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:3651:x1877767663826560:12345-0@lo:400:kworker.0 Request processed in 183us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779201.641160:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790779201.641189:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663826816 00000100:00100000:2.0:1790779201.641193:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663826816 00000100:00100000:2.0:1790779201.641212:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663827072 00000100:00100000:2.0:1790779201.641214:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663827072 00000100:00100000:2.0:1790779201.641225:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779201.641231:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663826816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779201.641268:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663826816:12345-0@lo:400:kworker.0 Request processed in 38us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779201.641274:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779201.641284:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779201.641289:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663827072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779201.641327:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663827072:12345-0@lo:400:kworker.0 Request processed in 37us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779201.641333:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779201.641348:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663826688 00000100:00100000:2.0:1790779201.641351:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663826688 00000100:00100000:2.0:1790779201.641360:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663826944 00000100:00100000:2.0:1790779201.641362:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663826944 00000100:00100000:2.0:1790779201.641374:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790779201.641379:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663826688:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1790779201.641414:0:17151:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1790779201.641448:0:17151:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936de6b 00000004:00100000:2.0:1790779201.641471:0:17151:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1790779201.641478:0:17151:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:2.0:1790779201.642533:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7603008380 x1877767663827072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779201.642869:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663827072:0@lo:400:kworker.0 00000100:00100000:1.0:1790779201.645819:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779201.645841:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663827200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779201.645944:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779201.646339:0:17152:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1790779201.646349:0:17152:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1790779201.647358:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663827200 00000100:00100000:1.0:1790779201.647369:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663827200 00000100:00100000:2.0:1790779201.647583:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779201.647594:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3649:x1877767663826944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779201.647678:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3649:x1877767663826944:12345-0@lo:400:kworker.0 Request processed in 86us (6915us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779201.647685:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779201.647729:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663826944:0@lo:400:kworker.0 00000100:00100000:1.0:1790779201.648180:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790779201.648188:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663827200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779201.648213:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790779201.648341:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663827200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779201.648348:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790779201.648383:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663827200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779201.649029:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663826560:0@lo:400:kworker.0 00010000:00080000:0.0:1790779201.649055:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b760300aa00 x1877767663826816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779201.649075:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663826816:0@lo:400:kworker.0 00000100:00080000:3.0:1790779201.656718:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9b7603b13800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779201.656828:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1877767663826688:12345-0@lo:38:kworker.0 Request processed in 15445us (16108us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779201.656838:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1790779201.657051:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790779201.657061:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1790779201.657066:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790779201.657068:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1790779201.657094:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c0376ba3): req@ffff9b773f4f5500 x1877767663819392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779201.657118:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663826688:0@lo:38:kworker.0 00000100:00100000:0.0:1790779201.657361:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779201.657375:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663827328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779201.657413:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779201.657493:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663827328 00000100:00100000:1.0:1790779201.657501:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663827328 00000100:00100000:1.0:1790779201.657538:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790779201.657556:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663827328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790779201.657584:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790779201.657633:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663827328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779201.657639:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790779201.657681:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663827328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779201.659424:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779201.659458:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779201.660452:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663819392 00000100:00100000:2.0:1790779201.660464:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663819392 00000100:00100000:2.0:1790779201.660522:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790779201.660531:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17188:x1877767663819392:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790779201.661126:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17188:x1877767663819392:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 595us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779201.661136:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790779201.661225:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17188:1877767663819392:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1790779201.661279:0:17188:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1790779201.661333:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17188:1877767663827456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790779201.661377:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779201.661421:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328240 going to sleep for 11 seconds 00000100:00100000:1.0:1790779201.661644:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663827456 00000100:00100000:1.0:1790779201.661649:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663827456 00000100:00100000:1.0:1790779201.661687:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790779201.661696:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17188:x1877767663827456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790779201.662221:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17188:x1877767663827456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 524us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779201.662228:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790779201.669392:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17188:1877767663827456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790779201.669733:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17188:1877767663827584:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790779201.670328:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779201.670375:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328240 going to sleep for 11 seconds 00000100:00100000:0.0:1790779201.670485:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663827584 00000100:00100000:0.0:1790779201.670493:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663827584 00000100:00100000:0.0:1790779201.670924:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790779201.670935:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17188:x1877767663827584:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790779201.671742:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17188:x1877767663827584:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 806us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779201.671752:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790779201.681510:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17188:1877767663827584:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1790779201.681590:0:17188:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779201.684905:0:17188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790779201.684993:0:17188:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:3.0:1790779201.685011:0:17188:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1790779202.088076:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790779202.166043:0:18148:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790779203.113037:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790779203.222069:0:18200:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790779203.222312:0:18200:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1790779203.560759:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779204.146185:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790779204.273311:0:18250:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779204.273539:0:18250:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790779205.169580:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790779205.489755:0:18299:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca1acc070 20000000:00000080:1.0:1790779205.489776:0:18299:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b7736710400 uarg=0000000000000000 20000000:01000000:1.0:1790779205.489827:0:18299:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790779205.489833:0:18299:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790779205.489838:0:18299:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790779205.490429:0:18300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1790779205.490608:0:18299:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790779205.500180:0:18299:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790779205.500210:0:18299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779205.500229:0:18299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7718768800/0xb1aa4014e936dd1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dd14 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779205.500804:0:18299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701662000/0xb1aa4014e936de1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de17 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779205.500820:0:18299:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779205.500865:0:18299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701662000/0xb1aa4014e936de1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936de17 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779205.500928:0:18299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7701662000/0xb1aa4014e936de1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936de17 expref: 17 pid: 17138 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779205.500944:0:18299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18299:1877767663827712:0@lo:104: 00000100:00100000:1.0:1790779205.501023:0:18299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790779205.501085:0:18299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7718768800/0xb1aa4014e936dd1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936dd14 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779205.501093:0:18299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7718768800/0xb1aa4014e936dd1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936dd14 expref: 17 pid: 17138 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779205.501103:0:18299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18299:1877767663827840:0@lo:104: 00000100:00100000:1.0:1790779205.501138:0:18299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779205.501160:0:18299:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779205.501236:0:17129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663827712 00000100:00100000:2.0:1790779205.501254:0:17129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663827712 00000100:00100000:2.0:1790779205.501302:0:17129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663827840 00000100:00100000:2.0:1790779205.501306:0:17129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663827840 00000100:00100000:2.0:1790779205.501321:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779205.501329:0:17129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+4:18299:x1877767663827712:12345-0@lo:104: 00010000:00010000:2.0:1790779205.501348:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501409:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790779205.501416:0:17129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+4:18299:x1877767663827712:12345-0@lo:104: Request processed in 88us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779205.501423:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779205.501441:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779205.501447:0:17129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+3:18299:x1877767663827840:12345-0@lo:104: 00010000:00010000:2.0:1790779205.501455:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501485:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790779205.501489:0:17129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+3:18299:x1877767663827840:12345-0@lo:104: Request processed in 44us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779205.501495:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790779205.501510:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779205.501517:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501523:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768c00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779205.501527:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501535:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779205.501542:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779205.501553:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779205.501582:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501589:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779205.501607:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501614:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718768c00/0xb1aa4014e936de17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de1e expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501625:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779205.501629:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501634:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3600 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779205.501637:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501643:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779205.501649:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779205.501655:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779205.501667:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501673:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779205.501685:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501693:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76039a3600/0xb1aa4014e936dd14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936dd1b expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501707:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779205.501709:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779205.501710:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779205.501718:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779205.501735:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663827968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779205.501778:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779205.501804:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779205.501810:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663828096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779205.501830:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779205.501856:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663827968 00000100:00100000:2.0:1790779205.501860:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663827968 00010000:00010000:2.0:1790779205.501907:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701662000/0xb1aa4014e936de1e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de17 expref: 18 pid: 17138 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779205.501928:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663828096 00000100:00100000:2.0:1790779205.501931:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663828096 00010000:00010000:2.0:1790779205.501942:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7718768800/0xb1aa4014e936dd1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936dd14 expref: 19 pid: 17138 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779205.501954:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779205.501961:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+19:3649:x1877767663827968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779205.501970:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779205.501975:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701662000/0xb1aa4014e936de1e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de17 expref: 19 pid: 17138 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.501995:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701662000/0xb1aa4014e936de1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936de17 expref: 19 pid: 17138 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502009:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779205.502037:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+19:3649:x1877767663827968:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779205.502044:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779205.502057:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779205.502062:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:3649:x1877767663828096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779205.502069:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779205.502073:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7718768800/0xb1aa4014e936dd1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936dd14 expref: 18 pid: 17138 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502081:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7718768800/0xb1aa4014e936dd1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936dd14 expref: 18 pid: 17138 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502092:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502100:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502112:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502118:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502124:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502136:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502141:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779205.502145:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502154:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502163:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779205.502172:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779205.502194:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:3649:x1877767663828096:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779205.502201:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779205.502237:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663828096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779205.502245:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663827968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779205.502354:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662000/0xb1aa4014e936de1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936de17 expref: 17 pid: 17138 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779205.502366:0:18299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18299:1877767663827712:0@lo:104: 00010000:00010000:1.0:1790779205.502374:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768800/0xb1aa4014e936dd1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936dd14 expref: 16 pid: 17138 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779205.502380:0:18299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18299:1877767663827840:0@lo:104: 00010000:00010000:1.0:1790779205.502396:0:18299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779205.502405:0:18299:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779205.502411:0:18299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779205.502418:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7603be7000/0xb1aa4014e936de72 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779205.736531:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779190/real 1790779190] req@ffff9b773f4f5f80 x1877767663820416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779205 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779205.736564:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b773f4f5f80 x1877767663820416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779205 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779205.736574:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779190/real 1790779190] req@ffff9b773f4f7100 x1877767663820544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779205 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779205.736607:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b773f4f7100 x1877767663820544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779205 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790779205.736627:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773b543800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779205.736651:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790779205.736654:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663820416:0@lo:8:kworker.0 00000100:00080000:1.0:1790779205.736659:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779205.736664:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790779205.736667:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663820544:0@lo:8:kworker.0 00000100:00080000:3.0:1790779205.736817:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779205.736821:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790779205.736823:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b773b543800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779205.736828:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:3.0:1790779205.736834:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790779205.736843:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b773b543800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779205.736859:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773f4f4a80 x1877767663828352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779205.736872:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779205.736875:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790779205.736891:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779205.736894:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:3.0:1790779205.736897:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790779205.736900:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b7704186000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779205.736909:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773f4f4e00 x1877767663828480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779205.736938:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779205.736942:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779205.736944:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779205.736947:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790779205.736982:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663828736:0@lo:400:kworker.0 00000100:00100000:3.0:1790779205.737046:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779205.737078:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779205.737084:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663828864:0@lo:400:kworker.0 00000100:00100000:3.0:1790779205.737109:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779205.737143:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663828864 00000100:00100000:3.0:1790779205.737150:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663828864 00000100:00100000:3.0:1790779205.737196:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779205.737203:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663828864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779205.737467:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663828224:0@lo:400:kworker.0 00000100:00100000:1.0:1790779205.737497:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779205.737518:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779205.737524:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663828608:0@lo:400:kworker.0 00000100:00100000:1.0:1790779205.737548:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779205.737578:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663828736 00000100:00100000:1.0:1790779205.737582:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663828736 00000100:00100000:1.0:1790779205.737606:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663828224 00000100:00100000:1.0:1790779205.737608:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663828224 00000100:00100000:1.0:1790779205.737621:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790779205.737626:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663828736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779205.737685:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663828864:12345-0@lo:400:kworker.0 Request processed in 481us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779205.737693:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779205.737709:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663828608 00000100:00100000:3.0:1790779205.737712:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663828608 00000100:00100000:3.0:1790779205.737725:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779205.737731:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663828608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779205.737776:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663828608:12345-0@lo:400:kworker.0 Request processed in 45us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779205.737782:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790779205.737816:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b773f4f7100 x1877767663828608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779205.737827:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663828608:0@lo:400:kworker.0 00000100:00100000:2.0:1790779205.741370:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663828352:0@lo:8:kworker.0 00000400:00000100:2.0:1790779205.741437:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663828352 offset 0 length 520: 4 00000100:00100000:2.0:1790779205.741478:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663828480:0@lo:8:kworker.0 00000400:00000100:2.0:1790779205.741524:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663828480 offset 0 length 520: 4 00000100:00100000:1.0:1790779205.742469:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663828736:12345-0@lo:400:kworker.0 Request processed in 4837us (5418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779205.742480:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790779205.742506:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790779205.742517:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663828224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779205.742595:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663828224:12345-0@lo:400:kworker.0 Request processed in 83us (5097us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779205.742601:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790779205.742645:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663828224:0@lo:400:kworker.0 00010000:00080000:3.0:1790779205.743165:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b773f4f4000 x1877767663828864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779205.743179:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663828864:0@lo:400:kworker.0 00000100:00100000:3.0:1790779205.743229:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663828736:0@lo:400:kworker.0 00010000:00010000:2.0:1790779206.185845:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790779206.632084:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790779206.632092:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7703509000 from 13 10000000:01000000:3.0:1790779206.632098:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790779206.632142:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779206.632154:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779206.632167:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779206.634572:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663828992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790779206.634650:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779206.634703:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328000 going to sleep for 11 seconds 00000100:00100000:1.0:1790779206.634825:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663828992 00000100:00100000:1.0:1790779206.634833:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663828992 00000100:00100000:1.0:1790779206.634905:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790779206.634916:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+16:17143:x1877767663828992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779206.636415:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779206.636446:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936de80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936de79 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779206.636476:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936de80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936de79 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779206.636487:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936de80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de79 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779206.636495:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6c00, rc 0) 00000100:00100000:1.0:1790779206.636566:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17143:x1877767663828992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1653us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779206.636575:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790779206.636948:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663828992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779206.636979:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779206.636990:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779206.637059:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663829120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779206.637092:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779206.637130:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328000 going to sleep for 11 seconds 00000100:00100000:2.0:1790779206.637201:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663829120 00000100:00100000:2.0:1790779206.637207:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663829120 00000100:00100000:2.0:1790779206.637269:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790779206.637285:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17143:x1877767663829120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779206.637407:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17143:x1877767663829120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779206.637414:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790779206.637600:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663829120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779206.637630:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663829248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779206.637670:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779206.637688:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790779206.637967:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663829248 00000100:00100000:2.0:1790779206.637973:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663829248 00000100:00100000:2.0:1790779206.638010:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790779206.638018:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17143:x1877767663829248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790779206.638104:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17143:x1877767663829248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779206.638112:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790779206.638155:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663829248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790779206.641454:0:18340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790779206.641664:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790779206.641691:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779206.641715:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779206.641727:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779206.641737:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790779206.641740:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7604541000 from 13 10000000:01000000:1.0:1790779206.641743:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779206.641776:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779206.641784:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779206.641796:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779206.641818:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663829376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779206.641906:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779206.641939:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779206.642081:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663829376 00000100:00100000:3.0:1790779206.642089:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663829376 00000100:00100000:3.0:1790779206.642145:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790779206.642153:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+17:17143:x1877767663829376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779206.642166:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779206.642177:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701663800/0xb1aa4014e936de8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936de87 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779206.642208:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701663800/0xb1aa4014e936de8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936de87 expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779206.642218:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701663800/0xb1aa4014e936de8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de87 expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779206.642234:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663800, rc 0) 00000100:00100000:3.0:1790779206.643389:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17143:x1877767663829376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1233us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779206.643399:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790779206.647827:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663829376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779206.647857:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779206.647869:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779206.648005:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663829504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779206.648080:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779206.648124:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779206.648418:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663829504 00000100:00100000:3.0:1790779206.648426:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663829504 00000100:00100000:3.0:1790779206.648473:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790779206.648482:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17143:x1877767663829504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779206.648610:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17143:x1877767663829504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779206.648618:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790779206.648656:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663829504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779206.648685:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663829632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779206.648723:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779206.648742:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328480 going to sleep for 11 seconds 00000100:00100000:3.0:1790779206.648761:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663829632 00000100:00100000:3.0:1790779206.648765:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663829632 00000100:00100000:3.0:1790779206.648787:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790779206.648793:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17143:x1877767663829632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779206.648864:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+18:17143:x1877767663829632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779206.648871:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790779206.648931:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663829632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790779206.650026:0:18342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790779206.659070:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790779206.659110:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779206.659121:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779206.659134:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779206.760097:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779196/real 1790779196] req@ffff9b7603008700 x1877767663822976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779206 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779206.760124:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603008700 x1877767663822976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779206 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779206.760134:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779196/real 1790779196] req@ffff9b760300ad80 x1877767663822848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779206 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779206.760145:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b760300ad80 x1877767663822848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779206 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790779206.760165:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779206.760188:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790779206.760192:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663822976:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790779206.760198:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7711492000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779206.760203:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790779206.760206:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663822848:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790779206.760440:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779206.760446:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779206.760449:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779206.760454:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779206.760490:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779206.760494:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790779206.760497:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7711492000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779206.760504:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00100000:3.0:1790779206.760505:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663830016:0@lo:400:kworker.0 00000100:00080000:2.0:1790779206.760510:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1790779206.760570:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779206.760615:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663830016 00000100:00100000:3.0:1790779206.760623:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663830016 00000100:00100000:3.0:1790779206.760662:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790779206.760670:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663830016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779206.760721:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663830016:12345-0@lo:400:kworker.0 Request processed in 51us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779206.760727:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790779206.760765:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663830016:0@lo:400:kworker.0 00000100:00100000:1.0:1790779206.760775:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663829888:0@lo:400:kworker.0 00000100:00100000:1.0:1790779206.760808:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779206.760830:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779206.760836:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663829760:0@lo:400:kworker.0 00000100:00100000:1.0:1790779206.760857:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790779206.761385:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b7711492000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779206.761409:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603008380 x1877767663830144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779206.761426:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779206.761430:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790779206.761432:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779206.761436:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1790779206.761439:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790779206.761446:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b7734583000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779206.761457:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b760300a300 x1877767663830272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779206.761632:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663829760 00000100:00100000:1.0:1790779206.761637:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663829760 00000100:00100000:1.0:1790779206.761665:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790779206.761680:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663829760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779206.762132:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663829760:12345-0@lo:400:kworker.0 Request processed in 452us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779206.762141:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790779206.762175:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663829760:0@lo:400:kworker.0 00000100:00100000:2.0:1790779206.762368:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663830400:0@lo:400:kworker.0 00000100:00100000:2.0:1790779206.762403:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779206.762455:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779206.762462:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663830528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779206.762486:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779206.762510:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663830144:0@lo:8:kworker.0 00000400:00000100:2.0:1790779206.762532:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663830144 offset 0 length 520: 4 00000100:00100000:2.0:1790779206.763332:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663830272:0@lo:8:kworker.0 00000400:00000100:2.0:1790779206.763360:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663830272 offset 0 length 520: 4 00000100:00100000:0.0:1790779206.763497:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779206.763511:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663830656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779206.763556:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779206.763770:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663830528 00000100:00100000:2.0:1790779206.763778:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663830528 00000100:00100000:2.0:1790779206.763805:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663830656 00000100:00100000:2.0:1790779206.763808:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663830656 00000100:00100000:2.0:1790779206.763821:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790779206.763836:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663830528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779206.763867:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790779206.763936:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663830528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779206.763943:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790779206.763962:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790779206.763969:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663830656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790779206.763984:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790779206.763993:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663830528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779206.764787:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663830656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 816us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779206.764796:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790779206.764836:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663830656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779206.769993:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663829888 00000100:00100000:3.0:1790779206.770009:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663829888 00000100:00100000:3.0:1790779206.770056:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663830400 00000100:00100000:3.0:1790779206.770060:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663830400 00000100:00100000:3.0:1790779206.770077:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790779206.770085:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663829888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779206.770298:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663829888:12345-0@lo:400:kworker.0 Request processed in 95us (9370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779206.770316:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790779206.770334:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790779206.770341:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663830400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779206.770384:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663830400:12345-0@lo:400:kworker.0 Request processed in 43us (7979us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779206.770390:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1790779206.770436:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b760300ad80 x1877767663830400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779206.770453:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663830400:0@lo:400:kworker.0 00010000:00080000:3.0:1790779206.770502:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b760300b800 x1877767663829888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779206.770512:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663829888:0@lo:400:kworker.0 00000001:00100000:3.0:1790779206.770655:0:17879:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1790779207.211172:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779208.232229:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790779208.874468:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790779209.257692:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779210.280025:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779211.304039:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790779211.802838:0:18647:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790779211.802842:0:18647:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790779211.802844:0:18647:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790779211.803033:0:18647:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b77340a4000 00000020:01000004:2.0:1790779211.803049:0:18647:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790779211.803062:0:18647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790779211.803076:0:18647:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b773409cd40) 00000020:00000080:2.0:1790779211.803159:0:18647:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790779211.838183:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1790779211.840418:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790779211.840803:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790779211.841064:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790779211.841314:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1790779211.841544:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790779211.841709:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1790779211.842707:0:18647:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790779211.842956:0:18647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1790779211.842968:0:18647:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790779211.842980:0:18647:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb1aa4014e936de9c 00000020:01000004:1.0:1790779211.842986:0:18647:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1790779211.843005:0:18647:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790779211.843008:0:18647:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790779211.843014:0:18647:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1790779211.843019:0:18647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1790779211.843030:0:18647:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b774116cd40) 00000020:00000080:1.0:1790779211.843040:0:18647:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1790779211.844306:0:18647:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779211.844524:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790779211.844536:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1790779211.846135:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1790779211.846145:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1790779211.846404:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1790779211.846410:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790779211.847928:0:18647:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790779211.848114:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790779211.848121:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790779211.848571:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790779211.848578:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790779211.859616:0:18647:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779211.859930:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790779211.859938:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1790779211.861254:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790779211.861265:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790779211.864796:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790779211.864807:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1790779211.874847:0:18647:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779211.875260:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1790779211.875273:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1790779211.875956:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1790779211.875964:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790779211.880265:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663830784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779211.880339:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779211.880567:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663830784 00000100:00100000:2.0:1790779211.880577:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663830784 00000100:00100000:2.0:1790779211.880628:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790779211.880647:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663830784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779211.880682:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790779211.880734:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663830784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779211.880749:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790779211.880791:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663830784:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1790779211.881097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779211.881102:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779211.881104:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779211.881107:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779211.881117:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779211.881120:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779211.881128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779211.881131:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790779211.881168:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663831168:0@lo:400:kworker.0 00000100:00100000:3.0:1790779211.881199:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779211.881238:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779211.881243:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663831040:0@lo:400:kworker.0 00000100:00100000:3.0:1790779211.881265:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779211.881292:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663831168 00000100:00100000:3.0:1790779211.881295:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663831168 00000100:00100000:3.0:1790779211.881322:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779211.881329:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663831168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779211.881366:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663831168:12345-0@lo:400:kworker.0 Request processed in 37us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779211.881373:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779211.881404:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663831040 00000100:00100000:3.0:1790779211.881408:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663831040 00000100:00100000:3.0:1790779211.881428:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790779211.881433:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663831040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779211.881462:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663831040:12345-0@lo:400:kworker.0 Request processed in 29us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779211.881467:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790779211.881494:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663831040:0@lo:400:kworker.0 00010000:00080000:3.0:1790779211.881505:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b76045f8e00 x1877767663831168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779211.881515:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663831168:0@lo:400:kworker.0 00000100:00100000:2.0:1790779211.881740:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663831296:0@lo:400:kworker.0 00000100:00100000:2.0:1790779211.881766:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779211.881785:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790779211.881796:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663830912:0@lo:400:kworker.0 00000100:00100000:2.0:1790779211.881823:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779211.881849:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663831424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779211.881872:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779211.881923:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663830912 00000100:00100000:2.0:1790779211.881928:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663830912 00000100:00100000:2.0:1790779211.881960:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790779211.881967:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+18:3649:x1877767663830912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779211.882003:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+18:3649:x1877767663830912:12345-0@lo:400:kworker.0 Request processed in 36us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779211.882009:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790779211.882037:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663831424 00000100:00100000:2.0:1790779211.882041:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663831424 00000100:00100000:2.0:1790779211.882061:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790779211.882068:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663831424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790779211.882092:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790779211.882128:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663831424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779211.882134:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790779211.882160:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663830912:0@lo:400:kworker.0 00000100:00100000:2.0:1790779211.882183:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663831424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779211.882499:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663831296 00000100:00100000:0.0:1790779211.882505:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663831296 00000100:00100000:0.0:1790779211.882570:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790779211.882577:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663831296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779211.882631:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663831296:12345-0@lo:400:kworker.0 Request processed in 50us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779211.882638:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1790779211.882687:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b76045f8000 x1877767663831296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779211.882696:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663831296:0@lo:400:kworker.0 00000100:00100000:0.0:1790779211.907509:0:18647:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790779211.907697:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1790779211.907703:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1790779211.908853:0:18647:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1790779211.908863:0:18647:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790779211.909249:0:18647:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790779211.909274:0:18647:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1790779211.909279:0:18647:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790779211.934615:0:18647:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790779211.934657:0:18647:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790779211.934662:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790779211.934664:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790779211.934665:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779211.934666:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779211.934668:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779211.934670:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779211.934671:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779211.934673:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779211.934674:0:18647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779211.934678:0:18647:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790779211.934680:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790779211.934682:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790779211.934683:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779211.934684:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779211.934685:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779211.934686:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779211.934687:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779211.934687:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779211.934688:0:18647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779211.934724:0:18647:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790779211.934744:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663831552:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790779211.934815:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779211.934867:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779211.935061:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663831552 00000100:00100000:1.0:1790779211.935069:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663831552 00000100:00100000:1.0:1790779211.935122:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790779211.935131:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:18647:x1877767663831552:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790779211.935170:0:17141:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790779211.935174:0:17141:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1790779211.935178:0:17141:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790779211.936608:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:18647:x1877767663831552:12345-0@lo:253:mount.lustre.0 Request processed in 1473us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779211.936619:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790779211.936743:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663831552:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790779211.936757:0:18647:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790779211.936766:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790779211.936767:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790779211.936768:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779211.936769:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779211.936770:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779211.936772:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779211.936773:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779211.936774:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779211.936776:0:18647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790779211.936796:0:18647:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b77340a4000 from lustre-OST0000 10000000:01000000:2.0:1790779211.936823:0:18647:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790779211.936826:0:18647:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790779211.936834:0:18647:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b773b784d40 local copy 00010000:00010000:2.0:1790779211.936844:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779211.937103:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663831680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779211.937138:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779211.937176:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b71c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779211.938352:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663831680 00000100:00100000:3.0:1790779211.938370:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663831680 00000100:00100000:3.0:1790779211.938425:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790779211.938435:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:18647:x1877767663831680:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779211.938550:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+18:18647:x1877767663831680:12345-0@lo:501:mount.lustre.0 Request processed in 116us (1410us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790779211.938558:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790779211.938710:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663831680:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790779211.938729:0:18647:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790779211.938752:0:18647:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790779211.938760:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779211.938770:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779211.938801:0:18647:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b77340a4000 10000000:01000000:0.0:1790779211.938806:0:18647:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790779211.938812:0:18647:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790779211.938815:0:18647:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790779211.938819:0:18647:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1790779211.938822:0:18647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790779211.938850:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779211.938859:0:18647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779211.938868:0:18647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779211.939070:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663831808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790779211.939107:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779211.940288:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779211.944306:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663831808 00000100:00100000:3.0:1790779211.944319:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663831808 00000100:00100000:3.0:1790779211.944391:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790779211.944401:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+18:18647:x1877767663831808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779211.944418:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779211.944438:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936deb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936deaa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779211.944466:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936deb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936deaa expref: 19 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779211.944480:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936deb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936deaa expref: 19 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779211.944490:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662a00, rc 0) 00000100:00100000:3.0:1790779211.944564:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+19:18647:x1877767663831808:12345-0@lo:101:mount.lustre.0 Request processed in 165us (5456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779211.944570:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790779211.946132:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663831808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779211.946158:0:18647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779211.946172:0:18647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779211.952982:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790779211.953788:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779211.959058:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790779211.959119:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790779211.959148:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790779211.959163:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790779211.959179:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790779211.959193:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790779211.959346:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790779211.959353:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790779211.959513:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663831936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779211.959576:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779211.959610:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771824d000 going to sleep for 11 seconds 00000100:00100000:3.0:1790779211.959789:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663831936 00000100:00100000:3.0:1790779211.959797:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663831936 00000100:00100000:3.0:1790779211.959847:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790779211.959862:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+19:18647:x1877767663831936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779211.960042:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+19:18647:x1877767663831936:12345-0@lo:501:mount.lustre.0 Request processed in 180us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779211.960050:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790779211.960229:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663831936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779211.960264:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779211.960305:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779211.960323:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b71c600 going to sleep for 11 seconds 00000100:00100000:3.0:1790779211.960522:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663832064 00000100:00100000:3.0:1790779211.960527:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663832064 00000100:00100000:3.0:1790779211.960557:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790779211.960565:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+19:18647:x1877767663832064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779211.961474:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+19:18647:x1877767663832064:12345-0@lo:503:mount.lustre.0 Request processed in 905us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779211.961485:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790779211.961686:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790779211.962447:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790779211.962533:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779211.962583:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779211.962666:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b71c600 going to sleep for 11 seconds 00000100:00100000:3.0:1790779211.962720:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663832192 00000100:00100000:3.0:1790779211.962725:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663832192 00000100:00100000:3.0:1790779211.962767:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790779211.962775:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+19:18647:x1877767663832192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779211.963502:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+19:18647:x1877767663832192:12345-0@lo:502:mount.lustre.0 Request processed in 726us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779211.963510:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790779211.963595:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790779211.963795:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790779211.963822:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790779211.963837:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790779211.963852:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790779211.964127:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790779211.964147:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790779211.964176:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790779211.964277:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790779211.964295:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1790779211.964307:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1790779211.964321:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1790779211.964333:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1790779211.964431:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779211.964481:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779211.964550:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b71c600 going to sleep for 11 seconds 00000100:00100000:1.0:1790779211.964662:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663832320 00000100:00100000:1.0:1790779211.964668:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663832320 00000100:00100000:1.0:1790779211.964709:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790779211.964716:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+19:18647:x1877767663832320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779211.964818:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+19:18647:x1877767663832320:12345-0@lo:502:mount.lustre.0 Request processed in 103us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779211.964825:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790779211.964932:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779211.964985:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1790779211.964994:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1790779211.965907:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790779211.965916:0:18664:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1790779211.965923:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.965926:0:18664:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790779211.965931:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779211.965945:0:18664:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b7741168000) 00000020:00000080:1.0:1790779211.965977:0:18664:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790779211.965983:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790779211.966056:0:18664:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b77340a4000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790779211.966064:0:18664:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790779211.966070:0:18664:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb1aa4014e936debf 00010000:00010000:1.0:1790779211.970871:0:18664:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1790779211.972820:0:18664:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1790779211.974809:0:18664:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1790779211.976138:0:18664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790779211.976149:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779211.976155:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.976157:0:18664:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790779211.976160:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790779211.976163:0:18664:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1790779211.976165:0:18664:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779211.976166:0:18664:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779211.976168:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790779211.976170:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.976171:0:18664:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790779211.976174:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779211.976177:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.976178:0:18664:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790779211.976181:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790779211.976182:0:18664:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790779211.976184:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779211.976186:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.976188:0:18664:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790779211.976190:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779211.976192:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.976193:0:18664:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790779211.976196:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790779211.976218:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779211.976234:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.976236:0:18664:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790779211.976239:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1790779211.976522:0:18647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790779211.976548:0:18647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790779211.976578:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779211.976590:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779211.976599:0:18647:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b77340a4000 from 1 10000000:01000000:0.0:1790779211.976602:0:18647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790779211.976636:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779211.976645:0:18647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779211.976656:0:18647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779211.976678:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790779211.976740:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779211.976780:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707546e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790779211.979611:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663832448 00000100:00100000:2.0:1790779211.979623:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663832448 00000100:00100000:2.0:1790779211.979706:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790779211.979718:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+19:18647:x1877767663832448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779211.979734:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779211.979751:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2400/0xb1aa4014e936decd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936dec6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779211.979780:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2400/0xb1aa4014e936decd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936dec6 expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779211.979792:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2400/0xb1aa4014e936decd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dec6 expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779211.979801:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2400, rc 0) 00000100:00100000:0.0:1790779211.979936:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779211.979956:0:18647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779211.979978:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+20:18647:x1877767663832448:12345-0@lo:101:mount.lustre.0 Request processed in 262us (3237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779211.979987:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:0.0:1790779211.980043:0:18647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779211.982554:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790779211.982821:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779211.984298:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790779211.984339:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790779211.984429:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790779211.984438:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790779211.984534:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779211.984622:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779211.984667:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77108d6780 going to sleep for 11 seconds 00000100:00100000:2.0:1790779211.985028:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663832576 00000100:00100000:2.0:1790779211.985037:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663832576 00000100:00100000:2.0:1790779211.985082:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790779211.985090:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+20:18647:x1877767663832576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779211.985537:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+20:18647:x1877767663832576:12345-0@lo:501:mount.lustre.0 Request processed in 445us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779211.985546:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790779211.985621:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779211.985655:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779211.985695:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779211.985720:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77108d6780 going to sleep for 11 seconds 00000100:00100000:2.0:1790779211.986026:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663832704 00000100:00100000:2.0:1790779211.986032:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663832704 00000100:00100000:2.0:1790779211.986060:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790779211.986068:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+20:18647:x1877767663832704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779211.986586:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+20:18647:x1877767663832704:12345-0@lo:503:mount.lustre.0 Request processed in 517us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779211.986594:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790779211.987418:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790779211.987838:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790779211.988125:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779211.988268:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779211.988345:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707546e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790779211.988446:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663832832 00000100:00100000:2.0:1790779211.988453:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663832832 00000100:00100000:2.0:1790779211.988528:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790779211.988538:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+20:18647:x1877767663832832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779211.988647:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+20:18647:x1877767663832832:12345-0@lo:502:mount.lustre.0 Request processed in 110us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779211.988655:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790779211.988725:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779211.988958:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1790779211.988997:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1790779211.989011:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1790779211.989024:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1790779211.989054:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1790779211.989070:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1790779211.989084:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1790779211.989096:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1790779211.989108:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1790779211.989119:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1790779211.989131:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1790779211.989153:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779211.989188:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779211.989594:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707546e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790779211.989651:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663832960 00000100:00100000:1.0:1790779211.989656:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663832960 00000100:00100000:1.0:1790779211.989687:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790779211.989695:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+20:18647:x1877767663832960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779211.989819:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+20:18647:x1877767663832960:12345-0@lo:502:mount.lustre.0 Request processed in 124us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779211.989826:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790779211.990063:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663832960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779211.990112:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1790779211.990121:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1790779211.991336:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779211.991346:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.991348:0:18668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790779211.991354:0:18668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b77340a4000 00000020:00000080:1.0:1790779211.991357:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790779211.991373:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779211.991376:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.991377:0:18668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790779211.991380:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779211.991382:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.991383:0:18668:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790779211.991386:0:18668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b77340a4000 00000020:00000080:1.0:1790779211.991388:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790779211.991438:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779211.991441:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.991442:0:18668:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790779211.991451:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779211.991453:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.991455:0:18668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790779211.991458:0:18668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b77340a4000 00000020:00000080:1.0:1790779211.991460:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790779211.991476:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779211.991479:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.991480:0:18668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790779211.991482:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779211.991484:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.991486:0:18668:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790779211.991489:0:18668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b77340a4000 00000020:00000080:1.0:1790779211.991491:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790779211.991508:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779211.991510:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779211.991511:0:18668:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790779211.991513:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1790779211.991679:0:18647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790779211.991702:0:18647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779211.991720:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779211.991732:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779211.991785:0:18647:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790779211.991788:0:18647:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b77340a4000 10000000:01000000:0.0:1790779211.991791:0:18647:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b77340a4000 10000000:01000000:0.0:1790779211.991794:0:18647:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790779211.991799:0:18647:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b77340a4000 from 1 10000000:01000000:0.0:1790779211.991802:0:18647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790779211.991828:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779211.991836:0:18647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779211.991846:0:18647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779211.991865:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790779211.991934:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779211.991969:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707546000 going to sleep for 11 seconds 00000100:00100000:1.0:1790779211.993784:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663833088 00000100:00100000:1.0:1790779211.993795:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663833088 00000100:00100000:1.0:1790779211.993839:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790779211.993846:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+20:18647:x1877767663833088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779211.993860:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779211.993874:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7603be7c00/0xb1aa4014e936dedb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ded4 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779211.993913:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be7c00/0xb1aa4014e936dedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ded4 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779211.993923:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7603be7c00/0xb1aa4014e936dedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ded4 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779211.993931:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7c00, rc 0) 00000100:00100000:1.0:1790779211.998124:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663833088:12345-0@lo:101:mount.lustre.0 Request processed in 4269us (6180us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779211.998137:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790779212.002283:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779212.002313:0:18647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779212.002326:0:18647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790779212.008713:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1790779212.010518:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790779212.010741:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1790779212.010767:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1790779212.010796:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1790779212.010813:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1790779212.010825:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1790779212.010838:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1790779212.010850:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1790779212.010863:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1790779212.010893:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1790779212.010922:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1790779212.010937:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1790779212.010950:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1790779212.012449:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1790779212.012502:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1790779212.012520:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1790779212.012536:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1790779212.012552:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1790779212.012567:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1790779212.012600:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1790779212.012619:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1790779212.012633:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1790779212.012648:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1790779212.012664:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1790779212.012680:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1790779212.012696:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1790779212.012713:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1790779212.012728:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1790779212.012743:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1790779212.012758:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1790779212.012773:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1790779212.012789:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1790779212.012805:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1790779212.012819:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1790779212.012832:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1790779212.012863:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1790779212.012898:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1790779212.012915:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1790779212.012940:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1790779212.012946:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1790779212.014548:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779212.014615:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779212.014710:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707546180 going to sleep for 11 seconds 00000100:00100000:3.0:1790779212.021444:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663833216 00000100:00100000:3.0:1790779212.021460:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663833216 00000100:00100000:0.0:1790779212.022788:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790779212.022803:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663833216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779212.023008:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663833216:12345-0@lo:501:mount.lustre.0 Request processed in 210us (8392us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779212.023016:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790779212.025709:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779212.025769:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779212.025836:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779212.029543:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77108d6840 going to sleep for 11 seconds 00000100:00100000:3.0:1790779212.029646:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663833344 00000100:00100000:3.0:1790779212.029655:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663833344 00000100:00100000:3.0:1790779212.029700:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790779212.029708:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663833344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779212.029836:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663833344:12345-0@lo:503:mount.lustre.0 Request processed in 129us (4000us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779212.029844:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790779212.033139:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833344:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790779212.033797:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790779212.034231:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779212.034379:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779212.034452:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77108d6840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779212.034534:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663833472 00000100:00100000:0.0:1790779212.034541:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663833472 00000100:00100000:0.0:1790779212.034608:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790779212.034617:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663833472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779212.034717:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663833472:12345-0@lo:502:mount.lustre.0 Request processed in 101us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779212.034725:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790779212.034785:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790779212.034974:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1790779212.035002:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1790779212.035017:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1790779212.035031:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1790779212.035043:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1790779212.035054:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1790779212.035066:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1790779212.035079:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1790779212.035092:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1790779212.035104:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1790779212.035116:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1790779212.035127:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1790779212.035137:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1790779212.035162:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1790779212.035181:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1790779212.035209:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1790779212.035234:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1790779212.035250:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1790779212.035273:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1790779212.035286:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1790779212.035303:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1790779212.035316:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1790779212.035326:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1790779212.035337:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1790779212.035358:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1790779212.035372:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1790779212.035394:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1790779212.035416:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1790779212.035443:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1790779212.035484:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1790779212.035500:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1790779212.035521:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1790779212.035533:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1790779212.035545:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1790779212.035567:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1790779212.035589:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1790779212.035603:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1790779212.035624:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1790779212.035640:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1790779212.035663:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1790779212.035677:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1790779212.035698:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1790779212.035710:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1790779212.035728:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1790779212.035741:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1790779212.035774:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1790779212.035797:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1790779212.035823:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1790779212.035897:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779212.036026:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779212.036066:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77108d6840 going to sleep for 11 seconds 00000100:00100000:1.0:1790779212.037067:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663833600 00000100:00100000:1.0:1790779212.037077:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663833600 00000100:00100000:1.0:1790779212.037120:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790779212.037127:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663833600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779212.037260:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663833600:12345-0@lo:502:mount.lustre.0 Request processed in 133us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779212.037269:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790779212.037577:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779212.037787:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1790779212.037816:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1790779212.037846:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779212.037917:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779212.037948:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779212.038060:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663833728 00000100:00100000:1.0:1790779212.038064:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663833728 00000100:00100000:1.0:1790779212.038085:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790779212.038091:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663833728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779212.038170:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663833728:12345-0@lo:502:mount.lustre.0 Request processed in 78us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779212.038177:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790779212.038278:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663833728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779212.038316:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1790779212.038323:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1790779212.039163:0:18674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790779212.039178:0:18674:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b774116b380) 00000020:00000080:1.0:1790779212.039439:0:18674:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1790779212.039529:0:18674:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b77340a4000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790779212.039534:0:18674:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b77340a4000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790779212.039537:0:18674:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b77340a4000 3 00010000:00080000:1.0:1790779212.039576:0:18674:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b773f4fe000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1790779212.043822:0:18674:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1790779212.044164:0:18674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790779212.044312:0:18674:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790779212.044326:0:18674:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb1aa4014e936dee9 00000100:00080000:2.0:1790779212.044337:0:18674:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790779212.044348:0:18674:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b773f4fe000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779212.044442:0:18674:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773b7a8380 x1877767663833856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779212.044467:0:18674:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790779212.044517:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779212.044522:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779212.044524:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779212.044526:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779212.044547:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779212.044550:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779212.044553:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779212.044555:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790779212.044587:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663833984:0@lo:400:kworker.0 00000100:00100000:2.0:1790779212.044651:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779212.044686:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779212.044692:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663834112:0@lo:400:kworker.0 00000100:00100000:2.0:1790779212.044715:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779212.044750:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663834240:0@lo:400:kworker.0 00000100:00100000:2.0:1790779212.044773:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779212.044799:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779212.044805:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663834368:0@lo:400:kworker.0 00000100:00100000:2.0:1790779212.044826:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779212.044862:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663833984 00000100:00100000:2.0:1790779212.044869:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663833984 00000100:00100000:2.0:1790779212.044919:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663834240 00000100:00100000:2.0:1790779212.044922:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663834240 00000100:00100000:2.0:1790779212.044938:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790779212.044946:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663833984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779212.046087:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663833856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790779212.046130:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779212.046325:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663833984:12345-0@lo:400:kworker.0 Request processed in 1378us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779212.046334:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790779212.046356:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790779212.046436:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663834240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779212.046478:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663834240:12345-0@lo:400:kworker.0 Request processed in 46us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779212.046484:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790779212.046506:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663834112 00000100:00100000:2.0:1790779212.046511:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663834112 00000100:00100000:2.0:1790779212.046783:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663834368 00000100:00100000:2.0:1790779212.046788:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663834368 00000100:00100000:2.0:1790779212.046797:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663833856 00000100:00100000:2.0:1790779212.046799:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663833856 00000100:00100000:2.0:1790779212.046808:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779212.046814:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663834112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779212.046846:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663834112:12345-0@lo:400:kworker.0 Request processed in 32us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779212.046852:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779212.046873:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790779212.046906:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663834368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779212.046939:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663834368:12345-0@lo:400:kworker.0 Request processed in 61us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779212.046945:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790779212.046957:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779212.046961:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663833856:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790779212.047828:0:17146:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:2.0:1790779212.047874:0:17146:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb1aa4014e936def0 00000004:00100000:2.0:1790779212.047906:0:17146:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790779212.047939:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9b77041d3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779212.048605:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877767663833856:12345-0@lo:38:llog_process_th.0 Request processed in 1639us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779212.048613:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790779212.048676:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b773b7a8000 x1877767663834368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779212.048690:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663834368:0@lo:400:kworker.0 00000100:00100000:2.0:1790779212.048704:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663834240:0@lo:400:kworker.0 00010000:00080000:2.0:1790779212.048738:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b773b7abb80 x1877767663834112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779212.048748:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663834112:0@lo:400:kworker.0 00000100:00100000:2.0:1790779212.048761:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663833984:0@lo:400:kworker.0 00000020:01000004:3.0:1790779212.049168:0:18674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790779212.049184:0:18674:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9b77305999c0) 00000020:00000080:3.0:1790779212.049214:0:18674:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1790779212.049306:0:18674:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b77340a4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790779212.049311:0:18674:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b77340a4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790779212.049313:0:18674:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b77340a4000 3 00010000:00080000:3.0:1790779212.049340:0:18674:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b771270d000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00080000:0.0:1790779212.052160:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b773b7a8380 x1877767663833856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779212.052175:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790779212.052184:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1790779212.052259:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790779212.052264:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790779212.052267:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773f4fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790779212.052276:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663833856:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1790779212.054794:0:18674:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1790779212.056524:0:18674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1790779212.056576:0:18674:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790779212.056589:0:18674:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb1aa4014e936defe 00000100:00080000:2.0:1790779212.056600:0:18674:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790779212.056610:0:18674:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9b771270d000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779212.056644:0:18674:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773b7aad80 x1877767663834496/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779212.056668:0:18674:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790779212.056822:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1877767663834496:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790779212.056915:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790779212.057299:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779212.057310:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779212.057313:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779212.057315:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779212.057318:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779212.057321:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779212.057323:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779212.057326:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790779212.058095:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663834496 00000100:00100000:2.0:1790779212.058105:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663834496 00000100:00100000:2.0:1790779212.058140:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779212.058147:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663834496:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790779212.058174:0:17148:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000040:00080000:3.0:1790779212.058439:0:18674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1790779212.058489:0:18647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790779212.058516:0:18647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790779212.058530:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779212.058541:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790779212.058591:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790779212.058594:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790779212.058595:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779212.058597:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779212.058598:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779212.058599:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779212.058601:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790779212.058603:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779212.058605:0:18647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790779212.058608:0:18647:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1790779212.058611:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790779212.058612:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790779212.058613:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779212.058619:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779212.058620:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779212.058621:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779212.058622:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790779212.058623:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779212.058624:0:18647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790779212.058640:0:18647:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790779212.058654:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663834624:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790779212.058707:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779212.058735:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854b0c0 going to sleep for 11 seconds 00000020:00000080:2.0:1790779212.058917:0:17148:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb1aa4014e936df05 00000004:00100000:2.0:1790779212.058933:0:17148:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790779212.059105:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9b77041d4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779212.059167:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877767663834496:12345-0@lo:38:llog_process_th.0 Request processed in 1019us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779212.059176:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790779212.059350:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b773b7aad80 x1877767663834496/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779212.059419:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790779212.059427:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1790779212.059434:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790779212.059438:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790779212.059440:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b771270d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790779212.059446:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1877767663834496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790779212.059495:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663834624 00000100:00100000:2.0:1790779212.059499:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663834624 00000100:00100000:2.0:1790779212.059536:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790779212.059544:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663834624:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790779212.059563:0:17140:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790779212.059575:0:17140:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790779212.064587:0:17140:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790779212.064702:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790779212.065064:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:18647:x1877767663834624:12345-0@lo:253:mount.lustre.0 Request processed in 5517us (6352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779212.065076:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790779212.065245:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:18647:1877767663834624:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790779212.065260:0:18647:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790779212.065264:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790779212.065266:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790779212.065267:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790779212.065268:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790779212.065269:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790779212.065271:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790779212.065273:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790779212.065275:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790779212.065276:0:18647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790779212.065291:0:18647:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1790779212.066552:0:17162:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790779212.066558:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790779212.066623:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.066640:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936de56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de4f expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.066647:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936de64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de5d expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.066655:0:17162:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.066693:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936de64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936de5d expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.066707:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936de64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936de5d expref: 20 pid: 17141 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779212.066720:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7abb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663834752:0@lo:104: 00000100:00100000:2.0:1790779212.066769:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790779212.066816:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936de56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936de4f expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.066823:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936de56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936de4f expref: 20 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779212.066831:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663834880:0@lo:104: 00000100:00100000:2.0:1790779212.066852:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779212.066899:0:17162:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711c36900 going to sleep for 11 seconds 00000100:00100000:2.0:1790779212.066922:0:17129:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790779212.066937:0:17129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663834752 00000100:00100000:2.0:1790779212.066944:0:17129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663834752 00000100:00100000:2.0:1790779212.066979:0:17129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663834880 00000100:00100000:2.0:1790779212.066982:0:17129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663834880 00000100:00100000:2.0:1790779212.066997:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790779212.067004:0:17129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+4:17162:x1877767663834752:12345-0@lo:104: 00010000:00010000:2.0:1790779212.067016:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067061:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790779212.067066:0:17129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+4:17162:x1877767663834752:12345-0@lo:104: Request processed in 64us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779212.067073:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790779212.067088:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790779212.067095:0:17129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741826850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+3:17162:x1877767663834880:12345-0@lo:104: 00010000:00010000:2.0:1790779212.067102:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067134:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790779212.067138:0:17129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741826850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+3:17162:x1877767663834880:12345-0@lo:104: Request processed in 45us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779212.067145:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790779212.067178:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779212.067184:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067203:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2800 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779212.067214:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067252:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779212.067260:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779212.067266:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790779212.067292:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067298:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779212.067318:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067324:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76039a2800/0xb1aa4014e936de5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de64 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067336:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779212.067339:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067344:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769c00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779212.067347:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067352:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779212.067491:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779212.067497:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790779212.067511:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067517:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779212.067524:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067531:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936de4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067544:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779212.067546:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779212.067548:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779212.067555:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779212.067572:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663835008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779212.067601:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779212.067624:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779212.067630:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663835136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779212.067652:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779212.067681:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663835008 00000100:00100000:2.0:1790779212.067685:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663835008 00010000:00010000:2.0:1790779212.067702:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936de64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de5d expref: 21 pid: 17141 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779212.067722:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663835136 00000100:00100000:2.0:1790779212.067731:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663835136 00010000:00010000:2.0:1790779212.067744:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936de56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de4f expref: 22 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779212.067757:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790779212.067763:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f89954ec-b1b4-4b66-a198-81b81a38f825+22:3651:x1877767663835008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779212.067773:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779212.067778:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936de64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de5d expref: 22 pid: 17141 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067787:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936de64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936de5d expref: 22 pid: 17141 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067801:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779212.067828:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f89954ec-b1b4-4b66-a198-81b81a38f825+22:3651:x1877767663835008:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779212.067834:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790779212.067846:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790779212.067852:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3651:x1877767663835136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779212.067860:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779212.067864:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936de56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de4f expref: 21 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067872:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936de56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936de4f expref: 21 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067903:0:17133:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067912:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790779212.067930:0:17133:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010985934s 00010000:00010000:2.0:1790779212.067936:0:17133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067943:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067950:0:17133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.067957:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.068079:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779212.068083:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.068092:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.068100:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.068110:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779212.068134:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3651:x1877767663835136:12345-0@lo:103:ldlm_bl.0 Request processed in 282us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779212.068141:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790779212.068326:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663835136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779212.068335:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663835008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779212.068443:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2a00/0xb1aa4014e936de64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936de5d expref: 20 pid: 17141 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779212.068454:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7abb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663834752:0@lo:104: 00010000:00010000:2.0:1790779212.068462:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936de56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936de4f expref: 19 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779212.068469:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663834880:0@lo:104: 00010000:00010000:2.0:1790779212.068480:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.068488:0:17162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.068494:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779212.068499:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936df0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1790779212.069777:0:18647:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790779212.072508:0:18647:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790779212.072518:0:18647:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790779212.072557:0:18647:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790779212.072605:0:18647:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790779212.072626:0:18647:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790779212.072645:0:18647:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1790779212.074313:0:18647:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779212.074606:0:18647:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790779212.329626:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790779212.752777:0:18727:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790779212.756713:0:18727:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790779213.354113:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790779213.801226:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790779213.801234:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7703509000 from 9 10000000:01000000:0.0:1790779213.801239:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790779213.801285:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779213.801308:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779213.801321:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779213.801349:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663835264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779213.801430:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779213.801477:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705a84480 going to sleep for 11 seconds 00000040:00080000:0.0:1790779213.802656:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790779213.806600:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663835264 00000100:00100000:1.0:1790779213.806615:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663835264 00000100:00100000:1.0:1790779213.806681:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790779213.806692:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+19:17143:x1877767663835264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779213.806708:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779213.806729:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7603be7e00/0xb1aa4014e936df1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936df13 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.806775:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be7e00/0xb1aa4014e936df1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936df13 expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.806786:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7603be7e00/0xb1aa4014e936df1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936df13 expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.806795:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7e00, rc 0) 00000100:00100000:1.0:1790779213.806862:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+20:17143:x1877767663835264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (5433us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779213.806869:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790779213.806957:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663835264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779213.806975:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.806984:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779213.808680:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663835392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790779213.808751:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779213.808796:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779213.808849:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663835392 00000100:00100000:0.0:1790779213.808856:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663835392 00000100:00100000:0.0:1790779213.808920:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790779213.808928:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+20:17143:x1877767663835392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790779213.808948:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790779213.808965:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790779213.808968:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1790779213.809667:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+20:17143:x1877767663835392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 737us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779213.809676:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790779213.810139:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663835392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790779213.810233:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790779213.810243:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.810256:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779213.810275:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790779213.810277:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7604541000 from 9 10000000:01000000:1.0:1790779213.810280:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790779213.811393:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.811409:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.811419:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779213.811446:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663835520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779213.811578:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779213.811618:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779213.811660:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663835520 00000100:00100000:1.0:1790779213.811666:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663835520 00000100:00100000:1.0:1790779213.811708:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790779213.811717:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+20:17143:x1877767663835520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779213.811729:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779213.811742:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936df28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936df21 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.811764:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936df28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936df21 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.811775:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936df28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936df21 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.811796:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6e00, rc 0) 00000100:00100000:1.0:1790779213.811831:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:17143:x1877767663835520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779213.811837:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790779213.811902:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663835520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779213.811917:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.811925:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779213.811973:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663835648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790779213.812751:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779213.812772:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779213.812790:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663835648 00000100:00100000:1.0:1790779213.812794:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663835648 00000100:00100000:1.0:1790779213.812820:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790779213.812826:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:17143:x1877767663835648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790779213.812841:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790779213.812860:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790779213.812864:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1790779213.812960:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:17143:x1877767663835648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779213.812968:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790779213.813013:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663835648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790779213.813070:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790779213.813078:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779213.813089:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779214.377799:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779215.401214:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779216.426214:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779217.000060:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779217.000084:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663835776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779217.000168:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779217.000241:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663835776 00000100:00100000:2.0:1790779217.000249:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663835776 00000100:00100000:2.0:1790779217.000297:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790779217.000306:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663835776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790779217.000339:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790779217.000382:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663835776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779217.000388:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790779217.000433:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663835776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779217.000985:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779217.000997:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663835904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779217.001031:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779217.001214:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663835904 00000100:00100000:3.0:1790779217.001219:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663835904 00000100:00100000:3.0:1790779217.001255:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790779217.001263:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663835904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790779217.001284:0:18106:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790779217.001325:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663835904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779217.001332:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790779217.001405:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663835904:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790779217.456078:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790779217.513474:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779217.513481:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779217.513483:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779217.513486:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779217.513498:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779217.513500:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779217.513503:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779217.513505:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790779217.513579:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663836032:0@lo:400:kworker.0 00000100:00100000:0.0:1790779217.513646:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779217.513725:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663836544:0@lo:400:kworker.0 00000100:00100000:0.0:1790779217.513756:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779217.513785:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779217.513791:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663836160:0@lo:400:kworker.0 00000100:00100000:0.0:1790779217.513813:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779217.513838:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663836288:0@lo:400:kworker.0 00000100:00100000:0.0:1790779217.513859:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779217.513875:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779217.513899:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663836416:0@lo:400:kworker.0 00000100:00100000:0.0:1790779217.513922:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779217.513950:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663836544 00000100:00100000:0.0:1790779217.513956:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663836544 00000100:00100000:0.0:1790779217.513996:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663836160 00000100:00100000:0.0:1790779217.513999:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663836160 00000100:00100000:0.0:1790779217.514010:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663836288 00000100:00100000:0.0:1790779217.514012:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663836288 00000100:00100000:0.0:1790779217.514021:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663836416 00000100:00100000:0.0:1790779217.514035:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663836416 00000100:00100000:0.0:1790779217.514054:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790779217.514062:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663836544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779217.514114:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663836544:12345-0@lo:400:kworker.0 Request processed in 52us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779217.514121:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790779217.514137:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790779217.514143:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663836160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779217.514191:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663836160:12345-0@lo:400:kworker.0 Request processed in 37us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779217.514197:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790779217.514209:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790779217.514214:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663836288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779217.514245:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663836288:12345-0@lo:400:kworker.0 Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779217.514251:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790779217.514262:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790779217.514268:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663836416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779217.514293:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663836416:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779217.514299:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1790779217.514334:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a8e00 x1877767663836416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779217.514359:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663836416:0@lo:400:kworker.0 00010000:00080000:0.0:1790779217.514370:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7aa680 x1877767663836288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779217.514377:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663836288:0@lo:400:kworker.0 00010000:00080000:0.0:1790779217.514403:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7ab480 x1877767663836160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779217.514410:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663836160:0@lo:400:kworker.0 00010000:00080000:0.0:1790779217.514419:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a8a80 x1877767663836544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779217.514435:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663836544:0@lo:400:kworker.0 00000100:00100000:2.0:1790779217.518311:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663836032 00000100:00100000:2.0:1790779217.518326:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663836032 00000100:00100000:2.0:1790779217.519077:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790779217.519090:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3651:x1877767663836032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779217.519220:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3651:x1877767663836032:12345-0@lo:400:kworker.0 Request processed in 133us (5572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779217.519228:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790779217.519325:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663836032:0@lo:400:kworker.0 00000100:00080000:3.0:1790779217.522107:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790779217.522115:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1790779218.098043:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1790779218.126422:0:19017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790779218.477735:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790779219.207981:0:19069:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790779219.208219:0:19069:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790779219.496091:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790779220.143218:0:19120:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790779220.143437:0:19120:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779220.520038:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779221.288012:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779206/real 1790779206] req@ffff9b7603008380 x1877767663830144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779221 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779221.288045:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603008380 x1877767663830144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779221 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779221.288056:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779206/real 1790779206] req@ffff9b760300a300 x1877767663830272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779221 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779221.288067:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b760300a300 x1877767663830272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779221 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790779221.288091:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7711492000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790779221.288112:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790779221.288117:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663830144:0@lo:8:kworker.0 00000100:00080000:0.0:1790779221.288124:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790779221.288130:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790779221.288132:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663830272:0@lo:8:kworker.0 00000100:00080000:2.0:1790779221.288274:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779221.288279:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779221.288282:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779221.288285:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790779221.288341:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f89954ec-b1b4-4b66-a198-81b81a38f825:3652:1877767663836672:0@lo:400:kworker.0 00000100:00100000:1.0:1790779221.288428:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779221.288485:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779221.288491:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663837056:0@lo:400:kworker.0 00000100:00100000:1.0:1790779221.288521:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779221.288557:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663837056 00000100:00100000:1.0:1790779221.288567:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663837056 00000100:00100000:1.0:1790779221.288632:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790779221.289367:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663837056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779221.290705:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663837056:12345-0@lo:400:kworker.0 Request processed in 1328us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779221.290721:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790779221.290813:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663837056:0@lo:400:kworker.0 00000100:00080000:2.0:1790779221.295348:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779221.295363:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790779221.295369:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7711492000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779221.295380:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 524 00000100:00080000:2.0:1790779221.295386:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790779221.295402:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b7711492000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779221.295451:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773b7aa680 x1877767663837184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779221.295478:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779221.295482:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790779221.295484:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779221.295487:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 524 00000100:00080000:2.0:1790779221.295490:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790779221.295494:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b7734583000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779221.295505:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773b7a8e00 x1877767663837312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779221.295583:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779221.295617:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663837440:0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.295694:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779221.296118:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663836800:0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.296171:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779221.296194:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663837568:0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.296225:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779221.296246:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790779221.296253:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663836928:0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.296276:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779221.296294:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663837696:0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.296319:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779221.296353:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663836672 00000100:00100000:2.0:1790779221.296363:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663836672 00000100:00100000:2.0:1790779221.296420:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790779221.296429:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3652:x1877767663836672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.296483:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3652:x1877767663836672:12345-0@lo:400:kworker.0 Request processed in 55us (8055us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779221.296491:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790779221.296528:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663837440 00000100:00100000:2.0:1790779221.296533:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663837440 00000100:00100000:2.0:1790779221.296552:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663837568 00000100:00100000:2.0:1790779221.296554:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663837568 00000100:00100000:2.0:1790779221.296584:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663836928 00000100:00100000:2.0:1790779221.296601:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663836928 00000100:00100000:2.0:1790779221.296614:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663837696 00000100:00100000:2.0:1790779221.296624:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663837696 00000100:00100000:2.0:1790779221.296645:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790779221.296652:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663837440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.296706:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663837440:12345-0@lo:400:kworker.0 Request processed in 54us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779221.296713:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790779221.296726:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790779221.296732:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663837568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.296765:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663837568:12345-0@lo:400:kworker.0 Request processed in 33us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779221.296771:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790779221.296781:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790779221.296787:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663836928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.296816:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663836928:12345-0@lo:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779221.296822:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790779221.296835:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790779221.296841:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663837696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.296866:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663837696:12345-0@lo:400:kworker.0 Request processed in 26us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779221.296871:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790779221.296908:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663836800 00000100:00100000:2.0:1790779221.296912:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663836800 00000100:00100000:2.0:1790779221.296939:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790779221.296944:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663836800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.296978:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663836800:12345-0@lo:400:kworker.0 Request processed in 34us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779221.296991:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1790779221.297049:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7aad80 x1877767663837440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779221.297064:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663837440:0@lo:400:kworker.0 00000100:00100000:2.0:1790779221.297093:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663837184:0@lo:8:kworker.0 00000100:00100000:2.0:1790779221.297124:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779221.297143:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663837312:0@lo:8:kworker.0 00000100:00100000:2.0:1790779221.297176:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779221.297225:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663837184 00000100:00100000:2.0:1790779221.297230:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663837184 00000100:00100000:2.0:1790779221.297247:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663837312 00000100:00100000:2.0:1790779221.297250:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663837312 00000100:00100000:2.0:1790779221.297258:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779221.297264:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1877767663837184:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790779221.297296:0:18653:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:2.0:1790779221.297332:0:18653:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936df2f 00002000:00100000:2.0:1790779221.297350:0:18653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9b77041d3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790779221.297356:0:18653:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1790779221.297360:0:18653:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790779221.297575:0:18653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1790779221.297605:0:18653:0:(import.c:65:import_set_state_nolock()) ffff9b77041d7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779221.297650:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1877767663837184:12345-0@lo:8:kworker.0 Request processed in 384us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779221.297657:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779221.297672:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779221.297685:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1877767663837312:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790779221.297699:0:18653:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790779221.298377:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f89954ec-b1b4-4b66-a198-81b81a38f825:3652:1877767663836672:0@lo:400:kworker.0 00000100:00080000:3.0:1790779221.300499:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779221.300509:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790779221.301990:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a8a80 x1877767663836928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779221.302011:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663836928:0@lo:400:kworker.0 00010000:00080000:1.0:1790779221.302036:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a9c00 x1877767663837696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779221.302045:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663837696:0@lo:400:kworker.0 00000100:00100000:1.0:1790779221.302057:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663836800:0@lo:400:kworker.0 00010000:00080000:1.0:1790779221.302067:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a8380 x1877767663837568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779221.302075:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663837568:0@lo:400:kworker.0 00010000:00080000:0.0:1790779221.302981:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7aa680 x1877767663837184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790779241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779221.302996:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790779221.303009:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1790779221.303020:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790779221.303027:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790779221.303032:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7711492000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790779221.303060:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790779221.303067:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663837184:0@lo:8:kworker.0 00000004:00080000:0.0:1790779221.303100:0:17887:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790779221.303226:0:17887:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 539310345710ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790779221.303233:0:17887:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1790779221.303365:0:17888:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790779221.303395:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1877767663837952:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1790779221.303477:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779221.303528:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711f8a480 going to sleep for 11 seconds 00000100:00100000:3.0:1790779221.303723:0:18652:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790779221.303732:0:18652:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790779221.303826:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663837824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779221.303862:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779221.306705:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663837952 00000100:00100000:3.0:1790779221.306722:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663837952 00000100:00080000:3.0:1790779221.306803:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779221.306933:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790779221.307267:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1877767663837952:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1790779221.308395:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663837824 00000100:00100000:0.0:1790779221.308406:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663837824 00000100:00100000:0.0:1790779221.308465:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790779221.308477:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1877767663837824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779221.308508:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790779221.308626:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1877767663837824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (4762us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779221.308634:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790779221.308702:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b76045f8380 x1877767663837824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779221.309180:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663837824:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1790779221.312429:0:17879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1790779221.315600:0:19170:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1790779221.315617:0:19170:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1790779221.315775:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1877767663837952:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8631us (12291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779221.315795:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790779221.316023:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b76045faa00 x1877767663837952/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790779237 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779221.316042:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1877767663837952:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1790779221.316070:0:17888:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1790779221.316134:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ce680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1877767663838080:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1790779221.316186:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779221.316221:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328600 going to sleep for 11 seconds 00000100:00100000:1.0:1790779221.316342:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663838080 00000100:00100000:1.0:1790779221.316351:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663838080 00000100:00100000:1.0:1790779221.316411:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790779221.316421:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17888:x1877767663838080:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790779221.316456:0:18652:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1790779221.316490:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17888:x1877767663838080:12345-0@lo:5:osp-pre-0-1.0 Request processed in 71us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779221.316498:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790779221.317742:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b76046ce680 x1877767663838080/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790779237 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779221.317762:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ce680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1877767663838080:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1790779221.317780:0:17888:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1790779221.317832:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ce680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1877767663838208:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1790779221.317922:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779221.317947:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328600 going to sleep for 11 seconds 00000100:00100000:1.0:1790779221.318103:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663838208 00000100:00100000:1.0:1790779221.318110:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663838208 00000100:00100000:1.0:1790779221.318181:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790779221.318192:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1877767663838208:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790779221.318254:0:19170:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1790779221.336528:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1877767663837312:12345-0@lo:8:kworker.0 Request processed in 38828us (39337us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790779221.336548:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790779221.336823:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790779221.336831:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790779221.336835:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663837312:0@lo:8:kworker.0 00000001:00080000:3.0:1790779221.389809:0:18648:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1790779221.389829:0:18648:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1790779221.390092:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17888:x1877767663838208:12345-0@lo:5:osp-pre-0-1.0 Request processed in 71895us (72163us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790779221.390110:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790779221.390420:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b76046ce680 x1877767663838208/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790779237 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779221.390434:0:17888:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790779221.390442:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ce680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17888:1877767663838208:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1790779221.390460:0:17888:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1790779221.390531:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17888:1877767663838336:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1790779221.390579:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779221.390621:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b7286c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779221.390770:0:17158:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663838336 00000100:00100000:1.0:1790779221.390778:0:17158:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663838336 00000100:00100000:1.0:1790779221.390826:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790779221.390835:0:17158:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17888:x1877767663838336:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1790779221.390915:0:17158:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17888:x1877767663838336:12345-0@lo:900:osp-pre-0-1.0 Request processed in 81us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779221.390922:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790779221.391286:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603a3c380 x1877767663838336/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790779237 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779221.391298:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17888:1877767663838336:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1790779221.545831:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779222.121202:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779222.121236:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663838464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779222.121354:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779222.121472:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663838464 00000100:00100000:3.0:1790779222.121483:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663838464 00000100:00100000:3.0:1790779222.121549:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790779222.121560:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663838464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790779222.121607:0:18106:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790779222.121671:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663838464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779222.121680:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790779222.121752:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663838464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779222.123689:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790779222.123715:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663838592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779222.123801:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779222.123856:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663838592 00000100:00100000:0.0:1790779222.123865:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663838592 00000100:00100000:0.0:1790779222.123926:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790779222.123936:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663838592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779222.123978:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790779222.124025:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663838592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779222.124033:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790779222.124077:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663838592:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790779222.570460:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790779223.024329:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790779223.592096:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779224.616872:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779225.386338:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779205/real 1790779205] req@ffff9b773f4f4a80 x1877767663828352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779225.386366:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b773f4f4a80 x1877767663828352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779225.386377:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779205/real 1790779205] req@ffff9b773f4f4e00 x1877767663828480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779225.386401:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b773f4f4e00 x1877767663828480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790779225.386420:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773b543800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779225.386437:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790779225.386441:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663828352:0@lo:8:kworker.0 00000100:00080000:2.0:1790779225.386447:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779225.386451:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790779225.386454:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663828480:0@lo:8:kworker.0 00000100:00080000:2.0:1790779225.386536:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779225.386540:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790779225.386543:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b773b543800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779225.386547:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 523 00000100:00080000:2.0:1790779225.386551:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790779225.386560:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b773b543800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779225.386577:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603a3e300 x1877767663838976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779225.386589:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779225.386592:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790779225.386593:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779225.386596:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 523 00000100:00080000:2.0:1790779225.386599:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790779225.386602:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b7704186000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779225.386611:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603a3ce00 x1877767663839104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779225.386641:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779225.386645:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790779225.386646:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779225.386649:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 539 00000100:00080000:2.0:1790779225.386651:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790779225.386655:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b7734583000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779225.386664:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603a3d500 x1877767663839616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779225.386700:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663838720:0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.386753:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.386791:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663839488:0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.386812:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.386831:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790779225.386836:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663839360:0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.386857:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.386871:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663840000:0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.386908:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.386929:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663838848:0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.386948:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.386962:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663839744:0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.386978:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.386992:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790779225.386996:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663839232:0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.387021:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.387035:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663839872:0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.387050:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.387064:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663838976:0@lo:8:kworker.0 00000100:00100000:2.0:1790779225.387080:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.387095:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663839104:0@lo:8:kworker.0 00000100:00100000:2.0:1790779225.387110:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.387134:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663839616:0@lo:8:kworker.0 00000100:00100000:2.0:1790779225.387153:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.387179:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663838720 00000100:00100000:2.0:1790779225.387186:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663838720 00000100:00100000:2.0:1790779225.387223:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790779225.387230:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3650:x1877767663838720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.387274:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3650:x1877767663838720:12345-0@lo:400:kworker.0 Request processed in 44us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779225.387281:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790779225.387311:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663839488 00000100:00100000:2.0:1790779225.387314:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663839488 00000100:00100000:2.0:1790779225.387338:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663838976 00000100:00100000:2.0:1790779225.387340:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663838976 00000100:00100000:2.0:1790779225.387347:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663839104 00000100:00100000:2.0:1790779225.387349:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663839104 00000100:00100000:2.0:1790779225.387354:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663839616 00000100:00100000:2.0:1790779225.387356:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663839616 00000100:00100000:2.0:1790779225.387363:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779225.387369:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663839488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.387396:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663839488:12345-0@lo:400:kworker.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779225.387408:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779225.387419:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790779225.387423:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1877767663838976:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790779225.387446:0:18654:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1790779225.387471:0:18654:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936df36 00002000:00100000:2.0:1790779225.387482:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b773424f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790779225.387486:0:18654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790779225.387489:0:18654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790779225.387552:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790779225.387570:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9b773424d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779225.387603:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1877767663838976:12345-0@lo:8:kworker.0 Request processed in 178us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779225.387609:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790779225.387619:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790779225.387623:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1877767663839104:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790779225.387633:0:18654:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790779225.387653:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1877767663839104:12345-0@lo:8:kworker.0 Request processed in 29us (542us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790779225.387658:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790779225.387667:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790779225.387670:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1877767663839616:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790779225.387678:0:18654:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790779225.387710:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1877767663839616:12345-0@lo:8:kworker.0 Request processed in 38us (556us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790779225.387722:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790779225.387739:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663839360 00000100:00100000:2.0:1790779225.387743:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663839360 00000100:00100000:2.0:1790779225.387761:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663838848 00000100:00100000:2.0:1790779225.387763:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663838848 00000100:00100000:2.0:1790779225.387773:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790779225.387778:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663839360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.387807:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663839360:12345-0@lo:400:kworker.0 Request processed in 28us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779225.387812:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790779225.387821:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790779225.387827:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663838848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.387852:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663838848:12345-0@lo:400:kworker.0 Request processed in 25us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779225.387858:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790779225.387871:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663840000 00000100:00100000:2.0:1790779225.387874:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663840000 00000100:00100000:2.0:1790779225.387910:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663839744 00000100:00100000:2.0:1790779225.387912:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663839744 00000100:00100000:2.0:1790779225.387920:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663839232 00000100:00100000:2.0:1790779225.387922:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663839232 00000100:00100000:2.0:1790779225.387930:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663839872 00000100:00100000:2.0:1790779225.387932:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663839872 00000100:00100000:2.0:1790779225.387944:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790779225.387948:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663840000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.387974:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663840000:12345-0@lo:400:kworker.0 Request processed in 25us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779225.387979:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790779225.387997:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790779225.388002:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663839744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.388026:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663839744:12345-0@lo:400:kworker.0 Request processed in 24us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779225.388031:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790779225.388040:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790779225.388045:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663839232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.388065:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663839232:12345-0@lo:400:kworker.0 Request processed in 20us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779225.388070:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790779225.388079:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790779225.388084:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663839872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.388104:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663839872:12345-0@lo:400:kworker.0 Request processed in 20us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779225.388109:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790779225.388175:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663839360:0@lo:400:kworker.0 00010000:00080000:2.0:1790779225.388187:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603a3ed80 x1877767663840000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779225.388197:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663840000:0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.388204:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663838720:0@lo:400:kworker.0 00010000:00080000:2.0:1790779225.388212:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603a3fb80 x1877767663839488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779225.388219:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663839488:0@lo:400:kworker.0 00000100:00080000:2.0:1790779225.388251:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779225.388255:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779225.388257:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790779225.388274:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603a3df80 x1877767663839232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779225.388283:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663839232:0@lo:400:kworker.0 00010000:00080000:2.0:1790779225.388292:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603a3ea00 x1877767663839872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779225.388300:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663839872:0@lo:400:kworker.0 00000100:00100000:2.0:1790779225.388307:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663838848:0@lo:400:kworker.0 00010000:00080000:2.0:1790779225.388315:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603a3ca80 x1877767663839744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779225.388322:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663839744:0@lo:400:kworker.0 00010000:00080000:2.0:1790779225.388344:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603a3e300 x1877767663838976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790779250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779225.388350:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790779225.388356:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790779225.388363:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790779225.388368:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790779225.388370:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773b543800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790779225.388383:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790779225.388387:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663838976:0@lo:8:kworker.0 00000100:00080000:2.0:1790779225.388396:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779225.388400:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790779225.388410:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663839104:0@lo:8:kworker.0 00000100:00080000:2.0:1790779225.388420:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779225.388423:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790779225.388426:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663839616:0@lo:8:kworker.0 00000004:00080000:2.0:1790779225.388448:0:17170:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790779225.388505:0:17170:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 543395624415ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790779225.388510:0:17170:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1790779225.392287:0:17171:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1790779225.392313:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17171:1877767663840256:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790779225.392376:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779225.392404:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773438d600 going to sleep for 11 seconds 00000100:00100000:1.0:1790779225.392417:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779225.392427:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663840128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779225.392449:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779225.392477:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663840128 00000100:00100000:1.0:1790779225.392483:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663840128 00000100:00100000:1.0:1790779225.392531:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790779225.392538:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663840128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779225.392564:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790779225.392601:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663840128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779225.392608:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790779225.392654:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603bd3b80 x1877767663840128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779225.392672:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663840128:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790779225.392689:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779225.392698:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663840256 00000100:00100000:1.0:1790779225.392701:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663840256 00000100:00100000:1.0:1790779225.392721:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790779225.392727:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17171:x1877767663840256:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790779225.394389:0:17126:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1790779225.394985:0:18654:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1790779225.394992:0:18654:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1790779225.394998:0:18654:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:2.0:1790779225.408293:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.408308:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.408326:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.408329:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.408336:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.408353:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.408364:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.408372:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.408404:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779225.408808:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.408815:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.408824:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.408827:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.408831:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.408840:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.408849:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.408857:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.408876:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790779225.409174:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.409179:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.409187:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.409190:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.409194:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.409213:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.409221:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.409228:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.409236:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790779225.409445:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790779225.409453:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409462:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.409466:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409476:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409494:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409512:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409530:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790779225.409533:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409539:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.409542:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409550:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409560:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409568:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409577:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779225.409580:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409586:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.409594:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409601:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409610:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409617:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.409628:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.409630:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.409632:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.409700:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.409705:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.409713:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.409717:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.409721:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.409730:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.409738:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.409755:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.409801:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790779225.410483:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779225.410490:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936df59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.410500:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1790779225.410503:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779225.410507:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936df59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.410519:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936df59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.410538:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936df59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.410547:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936df59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.410606:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790779225.410613:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.410620:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.410623:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.410633:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.410645:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.410658:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.410673:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779225.410676:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936df59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.410682:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.410685:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936df59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.410693:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936df59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.410701:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936df59 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.410708:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.410710:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.410712:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779225.410748:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.412647:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790779225.412659:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936df59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779225.413019:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779225.413660:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779225.413669:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936df60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.413683:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1790779225.413688:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779225.413695:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936df60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.413709:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936df60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.413719:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936df60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.414371:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936df60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.414396:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790779225.414422:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779225.414431:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936df60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779225.414441:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779225.414446:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936df60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779225.414458:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936df60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779225.414477:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936df60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779225.414496:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936df60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779225.414514:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779225.414515:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779225.414517:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779225.417151:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779225.417165:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936df67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.417180:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1790779225.417185:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779225.417192:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936df67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.417205:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936df67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.417216:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936df67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.417225:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936df67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.417246:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790779225.419277:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779225.419288:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936df67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.419300:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.419316:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936df67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.419327:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936df67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.419349:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936df67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.419424:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936df67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779225.419566:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779225.419570:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779225.419572:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.424607:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.424622:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.424639:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.424644:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.424650:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.424663:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.424672:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.424680:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.424697:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779225.424925:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779225.424931:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.424946:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779225.424951:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.424969:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.424983:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.424988:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936df6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.425003:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779225.425005:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779225.425007:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.425631:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.425639:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.425651:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.425654:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.425659:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.425670:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.425684:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.425692:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.425714:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790779225.425962:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779225.425970:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.425980:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.425984:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.425992:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.426006:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.426015:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936df75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.426040:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.426042:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.426045:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.426186:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.426194:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.426202:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.426206:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.426211:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.426223:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.426231:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.426238:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.426263:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779225.426941:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779225.426949:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.426967:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779225.426971:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.426980:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.427004:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.427013:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936df7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.427029:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.427032:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.427034:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.427228:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.427235:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.427244:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.427248:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.427253:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.427263:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.427271:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.427278:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.427299:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790779225.427744:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779225.427751:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.427760:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.427764:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.427772:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.427785:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.427842:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936df83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.427859:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.427861:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.427863:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.428410:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.428416:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936df8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.428427:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.428434:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.428439:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936df8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.428450:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936df8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.428458:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936df8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.428466:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936df8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.428489:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790779225.428815:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779225.428821:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936df8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.428840:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3e00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.428844:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936df8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.428853:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936df8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.428864:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936df8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.428872:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936df8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.428915:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.428917:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.428918:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.429039:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.429045:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936df91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.429053:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.429056:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.429061:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936df91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.429069:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936df91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.429078:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936df91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.429152:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936df91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.429197:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779225.429468:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.429475:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936df98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.429484:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.429487:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.429492:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936df98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.429500:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936df98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.429509:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936df98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.429516:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936df98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.429582:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790779225.429588:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936df91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.429595:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.429599:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936df91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.429607:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936df91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.429625:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936df91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.429633:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936df91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.429647:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779225.429650:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936df98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.429657:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.429660:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936df98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.429667:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936df98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.429675:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936df98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.429682:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.429683:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.429685:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779225.429750:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790779225.429755:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936df98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.430030:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.430159:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.430165:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dbf8d30/0xb1aa4014e936df9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430174:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.430178:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.430183:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dbf8d30/0xb1aa4014e936df9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430192:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dbf8d30/0xb1aa4014e936df9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430200:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dbf8d30/0xb1aa4014e936df9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430208:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dbf8d30/0xb1aa4014e936df9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430227:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790779225.430370:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779225.430376:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dbf8d30/0xb1aa4014e936df9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.430388:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.430392:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dbf8d30/0xb1aa4014e936df9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.430401:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dbf8d30/0xb1aa4014e936df9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.430413:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dbf8d30/0xb1aa4014e936df9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.430420:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dbf8d30/0xb1aa4014e936df9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.430433:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.430435:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.430437:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.430621:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.430628:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfa6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430636:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.430639:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.430649:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfa6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430660:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfa6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430669:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfa6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430676:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfa6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430692:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779225.430770:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779225.430775:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfa6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430782:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779225.430786:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfa6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430793:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfa6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430804:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfa6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430821:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfa6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.430834:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779225.430835:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779225.430837:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.432107:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.432115:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936dfad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432135:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.432138:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.432144:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936dfad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432154:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936dfad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432163:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936dfad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432171:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936dfad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432194:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779225.432560:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.432571:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943cb1f3/0xb1aa4014e936dfb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432580:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.432582:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.432586:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943cb1f3/0xb1aa4014e936dfb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432596:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943cb1f3/0xb1aa4014e936dfb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432603:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943cb1f3/0xb1aa4014e936dfb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432611:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943cb1f3/0xb1aa4014e936dfb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432623:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790779225.432830:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.432836:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009874a336/0xb1aa4014e936dfbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432844:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.432847:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.432850:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009874a336/0xb1aa4014e936dfbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432859:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009874a336/0xb1aa4014e936dfbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432894:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009874a336/0xb1aa4014e936dfbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432903:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009874a336/0xb1aa4014e936dfbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.432912:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1790779225.433303:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790779225.433311:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936dfad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433483:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779225.433488:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936dfad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433592:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936dfad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433616:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936dfad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433623:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936dfad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433642:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779225.433645:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943cb1f3/0xb1aa4014e936dfb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433653:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894aa00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779225.433656:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943cb1f3/0xb1aa4014e936dfb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433664:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943cb1f3/0xb1aa4014e936dfb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433674:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943cb1f3/0xb1aa4014e936dfb4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433681:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943cb1f3/0xb1aa4014e936dfb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433691:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779225.433694:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009874a336/0xb1aa4014e936dfbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433707:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ac00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779225.433711:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009874a336/0xb1aa4014e936dfbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433719:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009874a336/0xb1aa4014e936dfbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433729:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009874a336/0xb1aa4014e936dfbb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433737:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009874a336/0xb1aa4014e936dfbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.433753:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.433756:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.433759:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.434231:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.434238:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b6372c/0xb1aa4014e936dfc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.434336:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.434340:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.434345:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b6372c/0xb1aa4014e936dfc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.434356:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2b6372c/0xb1aa4014e936dfc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.434365:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b6372c/0xb1aa4014e936dfc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.434373:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b6372c/0xb1aa4014e936dfc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.434405:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779225.434673:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.434679:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936dfc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.434688:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.434691:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.434695:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936dfc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.434704:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936dfc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.434712:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936dfc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.434719:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936dfc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.434728:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790779225.434937:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779225.434943:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2b6372c/0xb1aa4014e936dfc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.434951:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894be00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779225.434954:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b6372c/0xb1aa4014e936dfc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.434963:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b6372c/0xb1aa4014e936dfc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.434983:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2b6372c/0xb1aa4014e936dfc2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.434990:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2b6372c/0xb1aa4014e936dfc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.435006:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779225.435010:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936dfc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.435017:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779225.435020:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936dfc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.435027:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936dfc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.435037:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936dfc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.435044:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e525ab48/0xb1aa4014e936dfc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.435053:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.435055:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.435061:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.435508:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.435514:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c833816/0xb1aa4014e936dfd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.435525:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.435533:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.435538:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c833816/0xb1aa4014e936dfd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.435548:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c833816/0xb1aa4014e936dfd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.435556:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c833816/0xb1aa4014e936dfd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.435564:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c833816/0xb1aa4014e936dfd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.435583:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779225.435823:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779225.435829:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c833816/0xb1aa4014e936dfd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.435837:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ba00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779225.435841:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c833816/0xb1aa4014e936dfd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.435849:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c833816/0xb1aa4014e936dfd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.435861:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c833816/0xb1aa4014e936dfd0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.435868:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c833816/0xb1aa4014e936dfd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.435914:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.435916:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.435918:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.436070:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.436076:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.436085:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.436088:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.436157:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.436167:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.436176:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.436190:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.436209:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779225.436412:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779225.436417:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.436425:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779225.436429:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.436447:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.436457:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfd7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.436465:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f022a77/0xb1aa4014e936dfd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.436477:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.436479:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.436481:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.436540:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.436546:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936dfde lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.436555:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.436558:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.436562:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936dfde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.436572:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936dfde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.436580:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936dfde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.436587:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936dfde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.436605:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779225.437426:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.437433:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c5735a/0xb1aa4014e936dfe5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.437449:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.437453:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.437457:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c5735a/0xb1aa4014e936dfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.437468:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068c5735a/0xb1aa4014e936dfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.437476:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c5735a/0xb1aa4014e936dfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.437484:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068c5735a/0xb1aa4014e936dfe5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.437491:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790779225.437841:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779225.437848:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936dfde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.437856:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779225.437860:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936dfde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.437869:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936dfde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.437896:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936dfde lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.437913:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004683654b/0xb1aa4014e936dfde lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.437928:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779225.437932:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068c5735a/0xb1aa4014e936dfe5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.437939:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779225.437943:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c5735a/0xb1aa4014e936dfe5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.437950:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.437952:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c5735a/0xb1aa4014e936dfe5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.437965:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068c5735a/0xb1aa4014e936dfe5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.437972:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c5735a/0xb1aa4014e936dfe5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.437982:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.437983:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779225.437985:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779225.438221:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779225.438229:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ebb9557/0xb1aa4014e936dfec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.438240:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1790779225.438243:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779225.438248:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ebb9557/0xb1aa4014e936dfec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.438258:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ebb9557/0xb1aa4014e936dfec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.438277:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ebb9557/0xb1aa4014e936dfec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.438285:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ebb9557/0xb1aa4014e936dfec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779225.438304:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790779225.438475:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779225.438482:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ebb9557/0xb1aa4014e936dfec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.438490:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779225.438502:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ebb9557/0xb1aa4014e936dfec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.438521:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ebb9557/0xb1aa4014e936dfec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.438532:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ebb9557/0xb1aa4014e936dfec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.438539:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ebb9557/0xb1aa4014e936dfec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779225.438553:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.438555:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779225.438557:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779225.440502:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779225.440512:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936dff3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.440533:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1790779225.440538:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779225.440543:0:18654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936dff3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.440555:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936dff3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.440564:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936dff3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.440571:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936dff3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779225.440599:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1790779225.441156:0:18654:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1790779225.441245:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17171:x1877767663840256:12345-0@lo:5:osp-pre-0-0.0 Request processed in 48513us (48863us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779225.441255:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790779225.441361:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17171:1877767663840256:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790779225.441435:0:17171:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1790779225.441485:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17171:1877767663840384:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790779225.441528:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779225.441561:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771824d240 going to sleep for 11 seconds 00000100:00100000:3.0:1790779225.441785:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663840384 00000100:00100000:3.0:1790779225.441792:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663840384 00010000:00010000:1.0:1790779225.441825:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779225.441835:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936dff3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779225.441837:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779225.441850:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17171:x1877767663840384:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1790779225.441851:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779225.441859:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936dff3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779225.441869:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936dff3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1790779225.441902:0:18653:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:1.0:1790779225.441949:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936dff3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779225.441958:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936dff3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779225.441990:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779225.441991:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779225.441993:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790779225.453167:0:18648:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1790779225.453204:0:18648:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790779225.454135:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17171:x1877767663840384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12275us (12594us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790779225.454147:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790779225.454251:0:17171:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1790779225.454259:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17171:1877767663840384:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790779225.454275:0:17171:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1790779225.643534:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779226.668011:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779226.731708:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663840512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779226.731780:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779226.731838:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663840512 00000100:00100000:0.0:1790779226.731846:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663840512 00000100:00100000:0.0:1790779226.731913:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790779226.731922:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663840512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779226.731949:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790779226.733199:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663840512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1273us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779226.733208:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790779226.733263:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663840512:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1790779227.229819:0:19465:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790779227.229823:0:19465:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790779227.229824:0:19465:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790779227.230171:0:19465:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b773424c000 00000020:01000004:2.0:1790779227.230188:0:19465:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790779227.230201:0:19465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790779227.230214:0:19465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b7734098000) 00000020:00000080:2.0:1790779227.230230:0:19465:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1790779227.249014:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779227.249036:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663840640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779227.249104:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779227.249146:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663840640 00000100:00100000:3.0:1790779227.249285:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663840640 00000100:00100000:3.0:1790779227.249335:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790779227.249409:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663840640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790779227.249442:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790779227.249507:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663840640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.249790:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779227.249802:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663840768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779227.249842:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779227.250040:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790779227.250059:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663840768 00000100:00100000:3.0:1790779227.250063:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663840768 00000100:00100000:3.0:1790779227.250080:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790779227.250087:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663840768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779227.250104:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790779227.250154:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663840768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779227.250335:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790779227.250404:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663840640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779227.251038:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663840768:0@lo:41:osp-pre-1-0.0 00100000:10000000:0.0:1790779227.293164:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790779227.295746:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790779227.296009:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790779227.296220:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790779227.298366:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790779227.298554:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790779227.299800:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1790779227.301684:0:19465:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790779227.301943:0:19465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790779227.301957:0:19465:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790779227.301967:0:19465:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb1aa4014e936e001 00000020:01000004:2.0:1790779227.301974:0:19465:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790779227.301994:0:19465:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790779227.301997:0:19465:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790779227.302002:0:19465:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790779227.302028:0:19465:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1790779227.302031:0:19465:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790779227.342830:0:19465:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790779227.342869:0:19465:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1790779227.342873:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790779227.343601:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790779227.343604:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779227.343605:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779227.343606:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779227.343608:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779227.343609:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790779227.343611:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779227.343613:0:19465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790779227.343616:0:19465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1790779227.343619:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790779227.343620:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790779227.343629:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779227.343630:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779227.343631:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779227.343632:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779227.343633:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790779227.343634:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779227.343635:0:19465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790779227.343660:0:19465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790779227.343680:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663840896:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790779227.343756:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779227.343798:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779227.343975:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663840896 00000100:00100000:2.0:1790779227.343983:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663840896 00000100:00100000:2.0:1790779227.344032:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790779227.344042:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:19465:x1877767663840896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790779227.344070:0:17141:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790779227.344074:0:17141:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1790779227.344151:0:17141:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790779227.345398:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:19465:x1877767663840896:12345-0@lo:253:mount.lustre.0 Request processed in 1354us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.345409:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790779227.345625:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663840896:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790779227.345638:0:19465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790779227.345641:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790779227.345642:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790779227.345644:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779227.345645:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779227.345646:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779227.345647:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779227.345649:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790779227.345650:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779227.345652:0:19465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790779227.345673:0:19465:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b773424c000 from lustre-OST0001 10000000:01000000:3.0:1790779227.345700:0:19465:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790779227.345702:0:19465:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790779227.345711:0:19465:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b773b784d40 local copy 00010000:00010000:3.0:1790779227.345721:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779227.345810:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779227.345845:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.346631:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663841024 00000100:00100000:2.0:1790779227.346652:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663841024 00000100:00100000:2.0:1790779227.346707:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790779227.346716:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+21:19465:x1877767663841024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779227.346804:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+21:19465:x1877767663841024:12345-0@lo:501:mount.lustre.0 Request processed in 89us (958us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790779227.346811:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790779227.347250:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77036f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1790779227.347272:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841024:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790779227.347300:0:19465:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790779227.347322:0:19465:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790779227.347329:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779227.347339:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779227.347368:0:19465:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b773424c000 10000000:01000000:3.0:1790779227.347373:0:19465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790779227.347379:0:19465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790779227.347382:0:19465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790779227.347386:0:19465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790779227.347389:0:19465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790779227.347414:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779227.347422:0:19465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779227.347430:0:19465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779227.347446:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841152:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790779227.347478:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.347607:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663841152 00000100:00100000:2.0:1790779227.347612:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663841152 00000100:00100000:2.0:1790779227.347647:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790779227.347655:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:19465:x1877767663841152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779227.347665:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779227.347678:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894aa00/0xb1aa4014e936e00f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e008 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.347699:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894aa00/0xb1aa4014e936e00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e008 expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.347710:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894aa00/0xb1aa4014e936e00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e008 expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.347718:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894aa00, rc 0) 00000100:00100000:2.0:1790779227.347744:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+22:19465:x1877767663841152:12345-0@lo:101:mount.lustre.0 Request processed in 90us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.347751:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790779227.348403:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77036f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1790779227.348422:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841152:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779227.348436:0:19465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779227.348455:0:19465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790779227.349787:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790779227.351015:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779227.355250:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790779227.355309:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790779227.355327:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790779227.355343:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790779227.355389:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790779227.355404:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790779227.355427:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790779227.355433:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790779227.356232:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779227.356298:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779227.356332:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77036f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779227.356403:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663841280 00000100:00100000:0.0:1790779227.356411:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663841280 00000100:00100000:0.0:1790779227.356459:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790779227.356469:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+22:19465:x1877767663841280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779227.356812:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+22:19465:x1877767663841280:12345-0@lo:501:mount.lustre.0 Request processed in 343us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779227.356820:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790779227.357000:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779227.357033:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779227.357074:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779227.357150:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77036f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779227.357296:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663841408 00000100:00100000:0.0:1790779227.357301:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663841408 00000100:00100000:0.0:1790779227.357380:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790779227.357388:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+22:19465:x1877767663841408:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779227.358689:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+22:19465:x1877767663841408:12345-0@lo:503:mount.lustre.0 Request processed in 1297us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779227.358698:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790779227.358788:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841408:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790779227.359715:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790779227.359802:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779227.360426:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779227.360475:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779227.360602:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663841536 00000100:00100000:2.0:1790779227.360609:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663841536 00000100:00100000:2.0:1790779227.360655:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790779227.360664:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+22:19465:x1877767663841536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779227.361270:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+22:19465:x1877767663841536:12345-0@lo:502:mount.lustre.0 Request processed in 605us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.361278:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790779227.361410:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779227.361611:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790779227.361639:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790779227.361654:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790779227.361667:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790779227.361679:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790779227.361690:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790779227.361700:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790779227.361711:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790779227.361722:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1790779227.361748:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779227.361786:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779227.361809:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779227.362275:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663841664 00000100:00100000:2.0:1790779227.362281:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663841664 00000100:00100000:2.0:1790779227.362322:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790779227.362330:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+22:19465:x1877767663841664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779227.362431:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+22:19465:x1877767663841664:12345-0@lo:502:mount.lustre.0 Request processed in 101us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.362438:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790779227.362810:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779227.362861:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1790779227.362914:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1790779227.363823:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790779227.363832:0:19470:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1790779227.363838:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779227.363841:0:19470:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1790779227.363847:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790779227.363864:0:19470:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b7730598000) 00000020:00000080:3.0:1790779227.363921:0:19470:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790779227.363929:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790779227.364017:0:19470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b773424c000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1790779227.364024:0:19470:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790779227.364031:0:19470:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb1aa4014e936e01d 00010000:00010000:3.0:1790779227.373320:0:19470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1790779227.374255:0:19470:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1790779227.377719:0:19470:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1790779227.379858:0:19470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790779227.379869:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779227.379911:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779227.379914:0:19470:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790779227.379921:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779227.379926:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779227.379927:0:19470:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790779227.379930:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790779227.379932:0:19470:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790779227.379934:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779227.379936:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779227.379938:0:19470:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790779227.379940:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779227.379942:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779227.379943:0:19470:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790779227.379947:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790779227.379974:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779227.379977:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779227.379979:0:19470:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790779227.379982:0:19470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1790779227.383776:0:19465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1790779227.383828:0:19465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790779227.383850:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779227.383863:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779227.383871:0:19465:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b773424c000 from 1 10000000:01000000:3.0:1790779227.383874:0:19465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790779227.383937:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779227.383946:0:19465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779227.383956:0:19465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779227.383979:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790779227.384043:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.384211:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663841792 00000100:00100000:2.0:1790779227.384221:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663841792 00000100:00100000:2.0:1790779227.384273:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790779227.384283:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+22:19465:x1877767663841792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779227.384296:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779227.384309:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e02b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e024 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.384332:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e02b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e024 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.384343:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e02b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e024 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.384352:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894a000, rc 0) 00000100:00100000:2.0:1790779227.384388:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:19465:x1877767663841792:12345-0@lo:101:mount.lustre.0 Request processed in 106us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.384405:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790779227.386306:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76038086c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779227.386353:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779227.386388:0:19465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.386401:0:19465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779227.388047:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1790779227.388343:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790779227.388539:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1790779227.388564:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1790779227.388581:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1790779227.388587:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1790779227.388653:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779227.388714:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.389580:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771d81b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779227.392061:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663841920 00000100:00100000:0.0:1790779227.392072:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663841920 00000100:00100000:0.0:1790779227.392294:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790779227.392318:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+23:19465:x1877767663841920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779227.392498:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+23:19465:x1877767663841920:12345-0@lo:501:mount.lustre.0 Request processed in 182us (3782us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779227.392507:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790779227.392589:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663841920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779227.392637:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779227.392685:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779227.402622:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76038086c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779227.402718:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663842048 00000100:00100000:2.0:1790779227.402728:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663842048 00000100:00100000:2.0:1790779227.402777:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790779227.402787:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:19465:x1877767663842048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779227.405706:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:19465:x1877767663842048:12345-0@lo:503:mount.lustre.0 Request processed in 2910us (13009us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.405721:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790779227.405855:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842048:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790779227.406784:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790779227.409229:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779227.409351:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.409588:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663842176 00000100:00100000:2.0:1790779227.409596:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663842176 00000100:00100000:2.0:1790779227.409646:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790779227.409655:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:19465:x1877767663842176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779227.412582:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:19465:x1877767663842176:12345-0@lo:502:mount.lustre.0 Request processed in 2917us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.412597:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790779227.412693:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779227.412721:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779227.413397:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790779227.413433:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790779227.413449:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790779227.413463:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790779227.413476:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790779227.413491:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790779227.413505:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790779227.413535:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1790779227.413552:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790779227.413566:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1790779227.413579:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1790779227.413617:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779227.413675:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779227.413716:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711fc20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779227.413960:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663842304 00000100:00100000:0.0:1790779227.413968:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663842304 00000100:00100000:0.0:1790779227.414011:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790779227.414020:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+23:19465:x1877767663842304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779227.414166:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+23:19465:x1877767663842304:12345-0@lo:502:mount.lustre.0 Request processed in 146us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779227.414173:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790779227.414318:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779227.414363:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1790779227.414372:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1790779227.415242:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779227.415321:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779227.415323:0:19474:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790779227.415331:0:19474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b773424c000 00000020:00000080:3.0:1790779227.415333:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779227.415342:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779227.415345:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779227.415346:0:19474:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790779227.415348:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779227.415361:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779227.415362:0:19474:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790779227.415366:0:19474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b773424c000 00000020:00000080:3.0:1790779227.415368:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779227.415457:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779227.415461:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779227.415463:0:19474:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790779227.415466:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779227.415468:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779227.415470:0:19474:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790779227.415473:0:19474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b773424c000 00000020:00000080:3.0:1790779227.415476:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779227.419355:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779227.421443:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779227.421451:0:19474:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790779227.421463:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779227.421468:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779227.421470:0:19474:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790779227.421475:0:19474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b773424c000 00000020:00000080:0.0:1790779227.421478:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790779227.421548:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779227.421551:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779227.421553:0:19474:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790779227.421556:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1790779227.421631:0:19465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790779227.421665:0:19465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779227.421683:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779227.421696:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779227.421760:0:19465:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790779227.421763:0:19465:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b773424c000 10000000:01000000:0.0:1790779227.421766:0:19465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b773424c000 10000000:01000000:0.0:1790779227.421770:0:19465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790779227.421775:0:19465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b773424c000 from 1 10000000:01000000:0.0:1790779227.421777:0:19465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790779227.421812:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779227.421821:0:19465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779227.421833:0:19465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779227.421856:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790779227.421942:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779227.421979:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790779227.423571:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663842432 00000100:00100000:0.0:1790779227.423580:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663842432 00000100:00100000:0.0:1790779227.423637:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790779227.423645:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:19465:x1877767663842432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779227.423660:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779227.423676:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768200/0xb1aa4014e936e039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e032 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779227.423701:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768200/0xb1aa4014e936e039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e032 expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779227.423725:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768200/0xb1aa4014e936e039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e032 expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779227.423734:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768200, rc 0) 00000100:00100000:0.0:1790779227.423798:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663842432:12345-0@lo:101:mount.lustre.0 Request processed in 153us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779227.423805:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790779227.423857:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779227.423872:0:19465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779227.423897:0:19465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779227.426522:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1790779227.426815:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779227.427040:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790779227.427066:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1790779227.427981:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1790779227.428009:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1790779227.428024:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1790779227.428039:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1790779227.428065:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1790779227.428079:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1790779227.428114:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1790779227.428130:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1790779227.428145:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1790779227.428158:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1790779227.428171:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1790779227.428187:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1790779227.428203:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1790779227.428216:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1790779227.428227:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1790779227.428239:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1790779227.428252:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1790779227.428265:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1790779227.428279:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1790779227.428292:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1790779227.428306:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1790779227.428319:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1790779227.428333:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1790779227.428346:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1790779227.428360:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1790779227.428397:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1790779227.428410:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1790779227.428422:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1790779227.428432:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1790779227.428443:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1790779227.428454:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1790779227.428465:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1790779227.428476:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1790779227.428487:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1790779227.428497:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1790779227.428508:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1790779227.428519:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1790779227.428539:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1790779227.428550:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1790779227.428561:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1790779227.428572:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1790779227.428583:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1790779227.428595:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1790779227.428605:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1790779227.428624:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1790779227.428629:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1790779227.428724:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779227.428788:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779227.428829:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720146840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779227.428983:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663842560 00000100:00100000:0.0:1790779227.428991:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663842560 00000100:00100000:0.0:1790779227.429428:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790779227.429439:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663842560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779227.429572:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663842560:12345-0@lo:501:mount.lustre.0 Request processed in 134us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779227.429579:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790779227.429645:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779227.429676:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779227.429711:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779227.429727:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720146840 going to sleep for 11 seconds 00000100:00100000:2.0:1790779227.429775:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663842688 00000100:00100000:2.0:1790779227.429780:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663842688 00000100:00100000:2.0:1790779227.429811:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790779227.429818:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663842688:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779227.429919:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663842688:12345-0@lo:503:mount.lustre.0 Request processed in 101us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.429925:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790779227.430046:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790779227.430649:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790779227.430713:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779227.430750:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779227.430773:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720146840 going to sleep for 11 seconds 00000100:00100000:2.0:1790779227.430832:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663842816 00000100:00100000:2.0:1790779227.430837:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663842816 00000100:00100000:2.0:1790779227.430869:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790779227.430876:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663842816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779227.430979:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663842816:12345-0@lo:502:mount.lustre.0 Request processed in 103us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.430986:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790779227.432244:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790779227.432686:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1790779227.432717:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1790779227.432730:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1790779227.432744:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1790779227.432758:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1790779227.432784:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1790779227.432798:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1790779227.432811:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1790779227.432823:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1790779227.432835:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1790779227.432849:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1790779227.432862:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1790779227.432874:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1790779227.438213:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1790779227.438248:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1790779227.438265:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1790779227.438278:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1790779227.438291:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1790779227.438305:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1790779227.438321:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1790779227.438335:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1790779227.438349:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1790779227.438363:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1790779227.438379:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1790779227.438394:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1790779227.438408:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1790779227.438422:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1790779227.438433:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1790779227.438444:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1790779227.438455:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1790779227.438466:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1790779227.438479:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1790779227.438493:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1790779227.438506:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1790779227.438519:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1790779227.438532:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1790779227.438543:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1790779227.438556:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1790779227.438581:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1790779227.438612:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1790779227.438626:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1790779227.438638:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1790779227.438652:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1790779227.438664:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1790779227.438677:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1790779227.438690:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1790779227.438704:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1790779227.438718:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1790779227.438774:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779227.438851:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779227.438911:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720146840 going to sleep for 11 seconds 00000100:00100000:2.0:1790779227.443939:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663842944 00000100:00100000:2.0:1790779227.443953:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663842944 00000100:00100000:2.0:1790779227.444013:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790779227.444024:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663842944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779227.444222:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663842944:12345-0@lo:502:mount.lustre.0 Request processed in 200us (5371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.444230:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790779227.444296:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663842944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779227.444537:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1790779227.444566:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1790779227.444601:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663843072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779227.444653:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779227.444692:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77124bed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779227.444911:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663843072 00000100:00100000:2.0:1790779227.444917:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663843072 00000100:00100000:2.0:1790779227.444946:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790779227.444953:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663843072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779227.445033:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663843072:12345-0@lo:502:mount.lustre.0 Request processed in 81us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.445040:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790779227.445120:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663843072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779227.445169:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1790779227.445177:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790779227.446563:0:19479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790779227.446593:0:19479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b7602648000) 00000020:00000080:0.0:1790779227.446617:0:19479:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1790779227.446701:0:19479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b773424c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790779227.446705:0:19479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b773424c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790779227.446708:0:19479:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b773424c000 3 00010000:00080000:0.0:1790779227.446736:0:19479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7720129800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1790779227.451117:0:19479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1790779227.451443:0:19479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790779227.451488:0:19479:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790779227.451516:0:19479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb1aa4014e936e047 00000100:00080000:0.0:1790779227.451525:0:19479:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790779227.451537:0:19479:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b7720129800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779227.451584:0:19479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603008380 x1877767663843200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779227.451755:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663843200:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790779227.451821:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790779227.451899:0:19479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790779227.451964:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663843200 00000100:00100000:3.0:1790779227.451973:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663843200 00000100:00100000:3.0:1790779227.452004:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779227.452012:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1877767663843200:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790779227.452033:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:3.0:1790779227.452062:0:17147:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb1aa4014e936e04e 00000004:00100000:3.0:1790779227.452075:0:17147:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790779227.452120:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9b7603428800 : changing import state from RECOVER to FULL 00000020:01000004:0.0:1790779227.452340:0:19479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790779227.452355:0:19479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9b76026499c0) 00000020:00000080:0.0:1790779227.452370:0:19479:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1790779227.452431:0:19479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b773424c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790779227.452435:0:19479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b773424c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790779227.452438:0:19479:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b773424c000 3 00010000:00080000:0.0:1790779227.452462:0:19479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7603411800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.103@tcp at head 00000100:00080000:2.0:1790779227.452509:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779227.452514:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790779227.452516:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779227.452521:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1790779227.452524:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1790779227.452530:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b7704186000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779227.452543:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b76044c9180 x1877767663843456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779227.453268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663843456:0@lo:8:kworker.0 00000100:00100000:1.0:1790779227.453329:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779227.453417:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877767663843200:12345-0@lo:38:llog_process_th.0 Request processed in 1403us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779227.453426:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790779227.453968:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779227.453972:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790779227.453975:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779227.453980:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1790779227.453984:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1790779227.453992:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b7734583000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779227.454009:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b76044cb480 x1877767663843840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779227.454060:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663843328:0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.454213:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.454256:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663844096:0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.454693:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.454720:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779227.454727:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663843968:0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.454749:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.454784:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663843456 00000100:00100000:2.0:1790779227.454792:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663843456 00000100:00100000:2.0:1790779227.454819:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663843328 00000100:00100000:2.0:1790779227.454822:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663843328 00000100:00100000:2.0:1790779227.454859:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779227.454868:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663843328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.455010:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663843328:12345-0@lo:400:kworker.0 Request processed in 143us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.455018:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779227.455032:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790779227.455037:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1877767663843456:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790779227.455362:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1877767663843456:12345-0@lo:8:kworker.0 Request processed in 322us (2032us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790779227.455368:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790779227.456045:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663843712:0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.456212:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.456241:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790779227.456248:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663843584:0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.456271:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790779227.456390:0:19479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1790779227.456575:0:19479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1790779227.456616:0:19479:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790779227.456629:0:19479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb1aa4014e936e05c 00000100:00080000:0.0:1790779227.456635:0:19479:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790779227.456644:0:19479:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b7603411800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779227.456670:0:19479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603009c00 x1877767663844352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790779227.456684:0:19479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1790779227.456765:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663844224:0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.456791:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.456815:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663844096 00000100:00100000:2.0:1790779227.456828:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663844096 00000100:00100000:2.0:1790779227.456859:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663843968 00000100:00100000:2.0:1790779227.456862:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663843968 00000100:00100000:2.0:1790779227.456873:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663843584 00000100:00100000:2.0:1790779227.456876:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663843584 00000100:00100000:2.0:1790779227.456919:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663844224 00000100:00100000:2.0:1790779227.456922:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663844224 00000100:00100000:2.0:1790779227.456937:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790779227.456943:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663844096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.456996:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663844096:12345-0@lo:400:kworker.0 Request processed in 53us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.457002:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790779227.457016:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790779227.457022:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663843968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.457049:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663843968:12345-0@lo:400:kworker.0 Request processed in 28us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.457054:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790779227.457066:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790779227.457071:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663843584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.457230:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663843584:12345-0@lo:400:kworker.0 Request processed in 158us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.457235:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790779227.457248:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790779227.457255:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663844224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.457352:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663844224:12345-0@lo:400:kworker.0 Request processed in 97us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.457358:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790779227.457460:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663843712 00000100:00100000:2.0:1790779227.457465:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663843712 00000100:00100000:2.0:1790779227.457488:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1790779227.457492:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1790779227.457494:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663843712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.457523:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663843712:12345-0@lo:400:kworker.0 Request processed in 30us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.457528:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790779227.457544:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779227.457548:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779227.457550:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790779227.457580:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b76044c8e00 x1877767663843968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779227.457593:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663843968:0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.457607:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663843328:0@lo:400:kworker.0 00010000:00080000:2.0:1790779227.457617:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b76044c9f80 x1877767663844096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779227.457625:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663844096:0@lo:400:kworker.0 00010000:00080000:1.0:1790779227.459114:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603008380 x1877767663843200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779227.459127:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790779227.459136:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1790779227.459144:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790779227.459148:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790779227.459151:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7720129800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790779227.459158:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663843200:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790779227.459180:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663843840:0@lo:8:kworker.0 00000100:00100000:1.0:1790779227.459222:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779227.459262:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1877767663844352:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790779227.459404:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663843840 00000100:00100000:3.0:1790779227.459410:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663843840 00000100:00100000:3.0:1790779227.459436:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779227.459442:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1877767663843840:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1790779227.459491:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1877767663843840:12345-0@lo:8:kworker.0 Request processed in 49us (269us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790779227.459506:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790779227.459610:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779227.459646:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790779227.459650:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779227.459653:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790779227.459656:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663843456:0@lo:8:kworker.0 00000100:00100000:1.0:1790779227.459670:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790779227.459672:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779227.459675:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790779227.459677:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663843840:0@lo:8:kworker.0 00000020:01000000:1.0:1790779227.459713:0:19465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790779227.459746:0:19465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790779227.459760:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779227.459771:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790779227.459821:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790779227.459824:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790779227.459825:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790779227.459826:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790779227.459827:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790779227.459829:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790779227.459831:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790779227.459832:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790779227.459834:0:19465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790779227.459837:0:19465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1790779227.459840:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790779227.459841:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790779227.459846:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790779227.459847:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790779227.459848:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790779227.459849:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790779227.459850:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790779227.459851:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790779227.459852:0:19465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790779227.459870:0:19465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790779227.460018:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663844480:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790779227.460053:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779227.460069:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77201469c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779227.460334:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663844352 00000100:00100000:3.0:1790779227.460338:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663844352 00000100:00100000:3.0:1790779227.460364:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779227.460369:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663844352:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790779227.460507:0:17148:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:3.0:1790779227.460552:0:17148:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb1aa4014e936e063 00000004:00100000:3.0:1790779227.460566:0:17148:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790779227.460593:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9b760342f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779227.460647:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877767663844352:12345-0@lo:38:llog_process_th.0 Request processed in 277us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779227.460655:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790779227.460992:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603009c00 x1877767663844352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779227.461002:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790779227.461008:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1790779227.461014:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790779227.461017:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790779227.461019:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7603411800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790779227.461023:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1877767663844352:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790779227.463572:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b76044ca300 x1877767663843584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779227.463590:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663843584:0@lo:400:kworker.0 00010000:00080000:3.0:1790779227.463610:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b76044c9c00 x1877767663844224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779227.463619:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663844224:0@lo:400:kworker.0 00000100:00100000:3.0:1790779227.463633:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663843712:0@lo:400:kworker.0 00000100:00100000:2.0:1790779227.463995:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663844480 00000100:00100000:2.0:1790779227.464003:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663844480 00000100:00100000:2.0:1790779227.464060:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790779227.464070:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+24:19465:x1877767663844480:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790779227.464097:0:17140:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790779227.464121:0:17140:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790779227.466538:0:17140:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790779227.466554:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790779227.466573:0:17162:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790779227.466577:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790779227.466596:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.466619:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7603be7e00/0xb1aa4014e936df1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936df13 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.466624:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936df28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936df21 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.466629:0:17162:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.466658:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936df28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936df21 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.466668:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936df28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936df21 expref: 24 pid: 17141 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779227.466678:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663844608:0@lo:104: 00000100:00100000:2.0:1790779227.466745:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790779227.466978:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7603be7e00/0xb1aa4014e936df1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936df13 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.466988:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7603be7e00/0xb1aa4014e936df1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936df13 expref: 24 pid: 17141 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779227.466998:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663844736:0@lo:104: 00000100:00100000:2.0:1790779227.467039:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.467055:0:17162:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779227.467076:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663844608 00000100:00100000:2.0:1790779227.467081:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663844608 00000100:00100000:2.0:1790779227.467122:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663844736 00000100:00100000:2.0:1790779227.467132:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663844736 00000100:00100000:2.0:1790779227.467151:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790779227.467159:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+4:17162:x1877767663844608:12345-0@lo:104: 00010000:00010000:2.0:1790779227.467171:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467212:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790779227.467218:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+4:17162:x1877767663844608:12345-0@lo:104: Request processed in 60us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.467225:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790779227.467241:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790779227.467247:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+3:17162:x1877767663844736:12345-0@lo:104: 00010000:00010000:2.0:1790779227.467255:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467287:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790779227.467292:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+3:17162:x1877767663844736:12345-0@lo:104: Request processed in 46us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.467297:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1790779227.467317:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779227.467323:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467331:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6800 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779227.467336:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467344:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779227.467361:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779227.467365:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790779227.467391:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467398:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779227.467412:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467417:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be6800/0xb1aa4014e936df21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936df28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467425:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779227.467427:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467430:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779227.467432:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467437:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779227.467507:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779227.467513:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790779227.467537:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467543:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779227.467557:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467564:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718769000/0xb1aa4014e936df13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936df1a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467581:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779227.467582:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779227.467584:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779227.467590:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779227.467604:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779227.467615:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663844864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779227.467645:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.467671:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663844992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779227.467697:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779227.467726:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663844864 00000100:00100000:2.0:1790779227.467730:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663844864 00010000:00010000:2.0:1790779227.467748:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936df28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936df21 expref: 25 pid: 17141 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779227.467767:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663844992 00000100:00100000:2.0:1790779227.467771:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663844992 00010000:00010000:2.0:1790779227.467798:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7603be7e00/0xb1aa4014e936df1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936df13 expref: 26 pid: 17141 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779227.467811:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790779227.467818:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+26:3651:x1877767663844864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779227.467832:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779227.467837:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936df28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936df21 expref: 26 pid: 17141 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467846:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936df28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936df21 expref: 26 pid: 17141 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467860:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779227.467905:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+26:3651:x1877767663844864:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.467912:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790779227.467924:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790779227.467929:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+25:3649:x1877767663844992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779227.467944:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779227.467948:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7603be7e00/0xb1aa4014e936df1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936df13 expref: 25 pid: 17141 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467957:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7603be7e00/0xb1aa4014e936df1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936df13 expref: 25 pid: 17141 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467968:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.467976:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790779227.467989:0:17132:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010985934s 00010000:00010000:2.0:1790779227.467993:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.468009:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.468016:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.468023:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.468028:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779227.468032:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.468039:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.468047:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.468055:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779227.468077:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+25:3649:x1877767663844992:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779227.468083:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790779227.468132:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663844992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779227.468152:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663844864:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779227.468170:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7603be6e00/0xb1aa4014e936df28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936df21 expref: 24 pid: 17141 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779227.468189:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663844608:0@lo:104: 00010000:00010000:2.0:1790779227.468199:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7603be7e00/0xb1aa4014e936df1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936df13 expref: 23 pid: 17141 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779227.468207:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17162:1877767663844736:0@lo:104: 00010000:00010000:2.0:1790779227.468219:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.468227:0:17162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.468233:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779227.468240:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e06a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779227.479647:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+22:19465:x1877767663844480:12345-0@lo:253:mount.lustre.0 Request processed in 15570us (19584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779227.479662:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790779227.481310:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f89954ec-b1b4-4b66-a198-81b81a38f825:19465:1877767663844480:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790779227.481329:0:19465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790779227.481332:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790779227.481334:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790779227.481335:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790779227.481336:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790779227.481338:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790779227.481339:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790779227.481340:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790779227.481342:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790779227.481343:0:19465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790779227.481357:0:19465:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1790779227.506994:0:19465:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790779227.523674:0:19465:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790779227.523684:0:19465:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790779227.523717:0:19465:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790779227.523762:0:19465:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790779227.523779:0:19465:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1790779227.523798:0:19465:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1790779227.525636:0:19465:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779227.526361:0:19465:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790779227.691289:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790779228.328525:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1790779228.394347:0:19533:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779228.394618:0:19533:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1790779228.648047:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790779228.648055:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7703509000 from 10 10000000:01000000:2.0:1790779228.648061:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790779228.648255:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779228.648267:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779228.648279:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779228.648417:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663845120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790779228.648481:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779228.648569:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779228.648607:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663845120 00000100:00100000:3.0:1790779228.648614:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663845120 00000100:00100000:3.0:1790779228.648772:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790779228.648783:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+22:17143:x1877767663845120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779228.648796:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779228.648810:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701662800/0xb1aa4014e936e078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e071 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779228.648832:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701662800/0xb1aa4014e936e078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e071 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779228.648843:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701662800/0xb1aa4014e936e078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e071 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779228.648852:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662800, rc 0) 00000100:00100000:3.0:1790779228.648981:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+23:17143:x1877767663845120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779228.648988:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790779228.649051:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663845120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779228.649065:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779228.649074:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779228.649238:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663845248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790779228.649270:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779228.651819:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77340b29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779228.651843:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663845248 00000100:00100000:2.0:1790779228.651851:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663845248 00000100:00100000:2.0:1790779228.651904:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790779228.651913:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:17143:x1877767663845248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790779228.651936:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790779228.651953:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790779228.651960:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1790779228.652081:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:17143:x1877767663845248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 168us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779228.652090:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790779228.652121:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663845248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790779228.652188:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790779228.652198:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779228.652210:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779228.652220:0:17143:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790779228.652223:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b7604541000 from 10 10000000:01000000:0.0:1790779228.652226:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790779228.652256:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779228.652264:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779228.652279:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779228.652306:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663845376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779228.652352:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779228.652382:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1790779228.652959:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663845376 00000100:00100000:3.0:1790779228.652965:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663845376 00000100:00100000:3.0:1790779228.653009:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790779228.653021:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+23:17143:x1877767663845376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779228.653032:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779228.653045:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701662c00/0xb1aa4014e936e086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e07f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779228.653069:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701662c00/0xb1aa4014e936e086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e07f expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779228.653080:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701662c00/0xb1aa4014e936e086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e07f expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779228.653104:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662c00, rc 0) 00000100:00100000:3.0:1790779228.653155:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:17143:x1877767663845376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779228.653161:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790779228.653189:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663845376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779228.653208:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779228.653218:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779228.653263:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663845504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790779228.653298:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779228.653365:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77201460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779228.653436:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663845504 00000100:00100000:2.0:1790779228.653440:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663845504 00000100:00100000:2.0:1790779228.653502:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790779228.653508:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+24:17143:x1877767663845504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790779228.653518:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790779228.653532:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790779228.653535:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1790779228.653606:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+24:17143:x1877767663845504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779228.653614:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790779228.653663:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663845504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790779228.653705:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790779228.653711:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779228.653720:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779228.712340:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779229.737488:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779230.761965:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779230.825676:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663845632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779230.825812:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779230.825916:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663845632 00000100:00100000:1.0:1790779230.825924:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663845632 00000100:00100000:1.0:1790779230.826048:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790779230.826058:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663845632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779230.826095:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1790779230.827362:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779230.827642:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663845632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779230.827781:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663845632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1573us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779230.827792:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790779231.784541:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779231.848016:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779231.848036:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663845760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779231.848110:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779231.848243:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663845760 00000100:00100000:0.0:1790779231.848251:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663845760 00000100:00100000:0.0:1790779231.848310:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790779231.848320:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663845760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779231.848341:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790779231.848387:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663845760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779231.848394:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790779231.848439:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663845760:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790779231.849222:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779232.360310:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779232.360332:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663845888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779232.360467:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779232.360530:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663845888 00000100:00100000:0.0:1790779232.360537:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663845888 00000100:00100000:0.0:1790779232.360579:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790779232.360588:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663845888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779232.360622:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790779232.360667:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663845888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779232.360674:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790779232.360718:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663845888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779232.360798:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790779232.360808:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663846016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779232.360836:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779232.360861:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663846016 00000100:00100000:3.0:1790779232.360865:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663846016 00000100:00100000:3.0:1790779232.360903:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790779232.360910:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663846016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790779232.360928:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790779232.360961:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663846016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779232.360966:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790779232.360993:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663846016:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790779232.809574:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790779232.873404:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779232.873425:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790779232.873429:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779232.873445:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b7704186000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779232.873470:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b760300b800 x1877767663846400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790779232.873501:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779232.873504:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790779232.873506:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779232.873511:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b7734583000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779232.873523:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b760300b480 x1877767663846784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790779232.873594:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663846272:0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.873655:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779232.873690:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663847040:0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.873713:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779232.873736:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790779232.873742:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663846528:0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.873761:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779232.873778:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663847168:0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.873797:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779232.873830:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663846272 00000100:00100000:0.0:1790779232.873837:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663846272 00000100:00100000:0.0:1790779232.873908:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790779232.873918:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663846272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.873968:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663846272:12345-0@lo:400:kworker.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779232.873981:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790779232.874004:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663847040 00000100:00100000:0.0:1790779232.874008:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663847040 00000100:00100000:0.0:1790779232.874027:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663846528 00000100:00100000:0.0:1790779232.874030:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663846528 00000100:00100000:0.0:1790779232.874041:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663847168 00000100:00100000:0.0:1790779232.874043:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663847168 00000100:00100000:0.0:1790779232.874056:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790779232.874063:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663847040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779232.874243:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663846144:0@lo:400:kworker.0 00000100:00100000:3.0:1790779232.874279:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779232.874311:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663846912:0@lo:400:kworker.0 00000100:00100000:3.0:1790779232.874333:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779232.874345:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663847424:0@lo:400:kworker.0 00000100:00100000:3.0:1790779232.874381:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779232.874394:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790779232.874400:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663846656:0@lo:400:kworker.0 00000100:00100000:3.0:1790779232.874419:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779232.874435:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663847296:0@lo:400:kworker.0 00000100:00100000:3.0:1790779232.874458:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779232.874476:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663846656 00000100:00100000:3.0:1790779232.874480:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663846656 00000100:00100000:3.0:1790779232.874504:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790779232.874510:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663846656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779232.874544:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663846656:12345-0@lo:400:kworker.0 Request processed in 35us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779232.874550:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790779232.874567:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663846144 00000100:00100000:3.0:1790779232.874569:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663846144 00000100:00100000:3.0:1790779232.874589:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790779232.874595:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3650:x1877767663846144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779232.874622:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3650:x1877767663846144:12345-0@lo:400:kworker.0 Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779232.874628:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790779232.874674:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663846656:0@lo:400:kworker.0 00000100:00100000:3.0:1790779232.874683:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663846144:0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.874755:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663847040:12345-0@lo:400:kworker.0 Request processed in 692us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779232.874762:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790779232.874773:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663846912 00000100:00100000:0.0:1790779232.874776:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663846912 00000100:00100000:0.0:1790779232.874789:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663847424 00000100:00100000:0.0:1790779232.874791:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663847424 00000100:00100000:0.0:1790779232.874803:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663847296 00000100:00100000:0.0:1790779232.874805:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663847296 00000100:00100000:0.0:1790779232.874819:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790779232.874824:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663846528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.874853:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663846528:12345-0@lo:400:kworker.0 Request processed in 29us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779232.874858:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790779232.874869:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790779232.874874:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663847168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.874925:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663847168:12345-0@lo:400:kworker.0 Request processed in 51us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779232.874930:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790779232.874947:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790779232.874951:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663846912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.874978:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663846912:12345-0@lo:400:kworker.0 Request processed in 27us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779232.874983:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790779232.874992:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790779232.874997:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663847424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.875032:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663847424:12345-0@lo:400:kworker.0 Request processed in 34us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779232.875038:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790779232.875048:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790779232.875053:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663847296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.875190:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663847296:12345-0@lo:400:kworker.0 Request processed in 136us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779232.875196:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1790779232.875219:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790779232.875223:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779232.875226:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790779232.875244:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760300ad80 x1877767663846528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779232.875255:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663846528:0@lo:400:kworker.0 00010000:00080000:0.0:1790779232.875266:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603008380 x1877767663847168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779232.875274:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663847168:0@lo:400:kworker.0 00000100:00100000:0.0:1790779232.875282:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663846272:0@lo:400:kworker.0 00010000:00080000:0.0:1790779232.875312:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603009c00 x1877767663847040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779232.875319:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663847040:0@lo:400:kworker.0 00010000:00080000:3.0:1790779232.875395:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041a7b80 x1877767663847296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779232.875405:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663847296:0@lo:400:kworker.0 00010000:00080000:3.0:1790779232.875425:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760300b100 x1877767663846912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779232.875432:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663846912:0@lo:400:kworker.0 00010000:00080000:3.0:1790779232.875441:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041a4e00 x1877767663847424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779232.875447:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663847424:0@lo:400:kworker.0 00000100:00100000:1.0:1790779232.875532:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663846400:0@lo:8:kworker.0 00000100:00100000:1.0:1790779232.875563:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779232.875589:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663846784:0@lo:8:kworker.0 00000100:00100000:1.0:1790779232.875611:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779232.875682:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663846400 00000100:00100000:3.0:1790779232.875686:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663846400 00000100:00100000:3.0:1790779232.875714:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663846784 00000100:00100000:3.0:1790779232.875717:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663846784 00000100:00100000:3.0:1790779232.875731:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790779232.875736:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1877767663846400:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790779232.875761:0:18654:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1790779232.875786:0:18654:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936e08d 00002000:00100000:3.0:1790779232.875798:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b760342a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790779232.875802:0:18654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1790779232.875805:0:18654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790779232.876001:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790779232.876023:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9b7603429000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779232.876062:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1877767663846400:12345-0@lo:8:kworker.0 Request processed in 324us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779232.876081:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790779232.876209:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790779232.876216:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1877767663846784:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790779232.876244:0:18654:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1790779232.876265:0:18654:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936e094 00002000:00100000:3.0:1790779232.876271:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9b7603428000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1790779232.876274:0:18654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1790779232.876276:0:18654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790779232.876300:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1790779232.876314:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9b760342e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779232.876344:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1877767663846784:12345-0@lo:8:kworker.0 Request processed in 127us (731us total) trans 0 rc 0/0 00010000:00080000:1.0:1790779232.881288:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760300b800 x1877767663846400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790779257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790779232.881312:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790779232.881320:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790779232.881326:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790779232.881330:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790779232.881410:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790779232.881418:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663846400:0@lo:8:kworker.0 00010000:00080000:1.0:1790779232.881439:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760300b480 x1877767663846784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790779257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790779232.881449:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1790779232.881454:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790779232.881457:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790779232.881459:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790779232.881478:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790779232.881481:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663846784:0@lo:8:kworker.0 00000004:00080000:1.0:1790779232.881553:0:17890:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790779232.881576:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1877767663847680:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1790779232.881630:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779232.881654:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720167a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790779232.881670:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663847552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779232.881704:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779232.881739:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663847680 00000100:00100000:1.0:1790779232.881746:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663847680 00000100:00100000:1.0:1790779232.881787:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790779232.881795:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:17890:x1877767663847680:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1790779232.882031:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663847552 00000100:00100000:1.0:1790779232.882035:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663847552 00000100:00100000:1.0:1790779232.882063:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790779232.882090:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3651:x1877767663847552:12345-0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1790779232.883241:0:17889:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790779232.883327:0:17889:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 550890446719ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790779232.883334:0:17889:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00000024:1.0:1790779232.884228:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790779232.884321:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3651:x1877767663847552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2237us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779232.884332:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790779232.884364:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790779232.884403:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603bd0380 x1877767663847552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779232.884425:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663847552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779232.885125:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:3.0:1790779232.885159:0:17172:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790779232.885232:0:17172:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 550892351646ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790779232.885238:0:17172:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1790779232.891369:0:17879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1790779232.891990:0:18652:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1790779232.891996:0:18652:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1790779232.892270:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17890:x1877767663847680:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10468us (10632us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779232.892282:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1790779232.892410:0:17890:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c50000 x1877767663847680/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790779248 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779232.892433:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1877767663847680:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1790779232.892453:0:17890:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1790779232.892519:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1877767663847808:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1790779232.892589:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779232.892633:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711cd6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790779232.892661:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663847808 00000100:00100000:0.0:1790779232.892669:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663847808 00000100:00100000:0.0:1790779232.892729:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790779232.892740:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17890:x1877767663847808:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1790779232.892776:0:19170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1790779232.892822:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17890:x1877767663847808:12345-0@lo:5:osp-pre-1-1.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779232.892830:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1790779232.893058:0:17890:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b77041a5180 x1877767663847808/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790779248 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779232.893084:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1877767663847808:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1790779232.893097:0:17890:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1790779232.893127:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1877767663847936:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1790779232.893170:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779232.893187:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711cd6240 going to sleep for 11 seconds 00000100:00100000:3.0:1790779232.893250:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663847936 00000100:00100000:3.0:1790779232.893261:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663847936 00000100:00100000:3.0:1790779232.893307:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790779232.893317:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17890:x1877767663847936:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1790779232.893363:0:18653:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:2.0:1790779232.893787:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663848064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779232.893846:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779232.894267:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663848064 00000100:00100000:2.0:1790779232.894273:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663848064 00000100:00100000:2.0:1790779232.894319:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790779232.894328:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663848064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790779232.894344:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790779232.894393:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663848064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779232.894401:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790779232.894444:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76044c9180 x1877767663848064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779232.894464:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663848064:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1790779232.894483:0:17173:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1790779232.894504:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17173:1877767663848192:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790779232.894531:0:17173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779232.894555:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663848192 00000100:00100000:2.0:1790779232.894558:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663848192 00000100:00100000:2.0:1790779232.894582:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790779232.894589:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17173:x1877767663848192:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790779232.898552:0:17126:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1790779232.898996:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454ff00 going to sleep for 11 seconds 00000100:00080000:1.0:1790779232.902742:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1790779232.908534:0:19170:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1790779232.908549:0:19170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1790779232.908557:0:19170:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:2.0:1790779232.927293:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.927315:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e09b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.927348:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.927353:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.927362:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e09b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.927386:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e09b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.927400:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e09b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.927410:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e09b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.927435:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.927841:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.927854:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e09b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.927972:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.927978:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e09b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.927989:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e09b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.928013:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e09b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.928020:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e09b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.928043:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.928045:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.928047:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.928167:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.928175:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.928189:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.928194:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.928199:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.928211:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.928234:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.928243:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.928350:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779232.928648:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.928654:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.928663:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.928666:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.928671:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.928680:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.928687:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.928694:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.937270:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790779232.937312:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779232.937322:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.937336:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ba00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779232.937342:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.937353:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.937377:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.937384:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.937412:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779232.937416:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.937422:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779232.937425:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.937452:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.937463:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.937469:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.937483:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779232.937485:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779232.937486:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.941810:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790779232.942062:0:19466:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1790779232.942095:0:19466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1790779232.942100:0:19466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790779232.942263:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17890:x1877767663847936:12345-0@lo:5:osp-pre-1-1.0 Request processed in 48944us (49088us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790779232.942274:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790779232.942325:0:17890:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790779232.942332:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17890:1877767663847936:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1790779232.942348:0:17890:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1790779232.942404:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17890:1877767663848320:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1790779232.942436:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779232.942456:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772fe83c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779232.942487:0:17157:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663848320 00000100:00100000:2.0:1790779232.942493:0:17157:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663848320 00000100:00100000:2.0:1790779232.942525:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779232.942532:0:17157:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17890:x1877767663848320:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1790779232.942572:0:17157:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17890:x1877767663848320:12345-0@lo:900:osp-pre-1-1.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779232.942578:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790779232.942604:0:17890:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603a3d500 x1877767663848320/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790779248 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779232.942615:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17890:1877767663848320:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1790779232.944695:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779232.944711:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe18cbe/0xb1aa4014e936e0b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.944728:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=550s v=(0 0) 00010000:00010000:3.0:1790779232.944733:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779232.944739:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fe18cbe/0xb1aa4014e936e0b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.944768:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fe18cbe/0xb1aa4014e936e0b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.944779:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe18cbe/0xb1aa4014e936e0b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.944787:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fe18cbe/0xb1aa4014e936e0b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.944809:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779232.945269:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779232.945275:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fe18cbe/0xb1aa4014e936e0b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.945284:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779232.945288:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe18cbe/0xb1aa4014e936e0b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.945297:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe18cbe/0xb1aa4014e936e0b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.945314:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fe18cbe/0xb1aa4014e936e0b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.945321:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fe18cbe/0xb1aa4014e936e0b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.945354:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779232.945356:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779232.945358:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.945543:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.945549:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b6372c/0xb1aa4014e936e0b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.945557:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.945561:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.945564:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b6372c/0xb1aa4014e936e0b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.945572:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b6372c/0xb1aa4014e936e0b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.945579:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b6372c/0xb1aa4014e936e0b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.945587:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b6372c/0xb1aa4014e936e0b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.945606:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.945740:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.945745:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b6372c/0xb1aa4014e936e0b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.945752:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894be00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.945755:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b6372c/0xb1aa4014e936e0b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.945763:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b6372c/0xb1aa4014e936e0b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.945774:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b6372c/0xb1aa4014e936e0b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.945780:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b6372c/0xb1aa4014e936e0b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.945803:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.945804:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.945806:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.946300:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.946306:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009874a336/0xb1aa4014e936e0be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.946325:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.946328:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.946333:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009874a336/0xb1aa4014e936e0be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.946342:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009874a336/0xb1aa4014e936e0be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.946351:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009874a336/0xb1aa4014e936e0be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.946359:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009874a336/0xb1aa4014e936e0be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.946378:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.946495:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.946501:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009874a336/0xb1aa4014e936e0be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.946508:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ac00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.946511:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009874a336/0xb1aa4014e936e0be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.946519:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009874a336/0xb1aa4014e936e0be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.946530:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009874a336/0xb1aa4014e936e0be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.946537:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009874a336/0xb1aa4014e936e0be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.946552:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.946554:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.946555:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.948023:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.948032:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dbf8d30/0xb1aa4014e936e0c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.948046:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.948049:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.948054:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dbf8d30/0xb1aa4014e936e0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.948063:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dbf8d30/0xb1aa4014e936e0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.948191:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dbf8d30/0xb1aa4014e936e0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.948201:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dbf8d30/0xb1aa4014e936e0c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.948218:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.948382:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.948389:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dbf8d30/0xb1aa4014e936e0c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.948408:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.948421:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dbf8d30/0xb1aa4014e936e0c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.948430:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dbf8d30/0xb1aa4014e936e0c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.948444:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dbf8d30/0xb1aa4014e936e0c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.948451:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dbf8d30/0xb1aa4014e936e0c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.948469:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.948470:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.948472:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.951187:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.951201:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.951217:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.951222:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.951228:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.951242:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.951251:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.951259:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.951300:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.951543:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.951551:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.951559:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.951563:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.951572:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.951592:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.951599:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e525ab48/0xb1aa4014e936e0cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.951615:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.951617:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.951618:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.951753:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.951759:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.951768:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.951771:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.951775:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.951782:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.951790:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.951797:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.951816:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.951964:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.951970:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.951977:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ba00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.951981:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.951989:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.951999:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.952006:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c833816/0xb1aa4014e936e0d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.952030:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.952031:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.952033:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.952672:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.952686:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e0da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.952704:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.952721:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.952728:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e0da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.952743:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e0da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.952849:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e0da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.952859:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e0da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.952909:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.952943:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.952950:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e0da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.952960:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.952964:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e0da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.952984:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e0da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.952997:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e0da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.953005:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f022a77/0xb1aa4014e936e0da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.953024:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.953026:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.953028:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.953497:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.953505:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936e0e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.953517:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.953521:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.953525:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936e0e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.953536:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936e0e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.953545:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936e0e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.953560:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936e0e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.953582:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.953615:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.953624:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936e0e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.953652:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.953656:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936e0e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.953664:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936e0e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.953679:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936e0e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.953687:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068c5735a/0xb1aa4014e936e0e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.953708:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.953711:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.953714:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.954000:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.954007:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ebb9557/0xb1aa4014e936e0e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.954017:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.954020:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.954023:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ebb9557/0xb1aa4014e936e0e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.954030:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ebb9557/0xb1aa4014e936e0e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.954115:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ebb9557/0xb1aa4014e936e0e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.954123:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ebb9557/0xb1aa4014e936e0e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.954143:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.954184:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.954192:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ebb9557/0xb1aa4014e936e0e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.954201:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.954205:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ebb9557/0xb1aa4014e936e0e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.954215:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ebb9557/0xb1aa4014e936e0e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.954238:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ebb9557/0xb1aa4014e936e0e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.954245:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ebb9557/0xb1aa4014e936e0e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.954262:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.954264:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.954266:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.954557:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.954563:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e0ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.954574:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.954576:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.954579:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e0ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.954586:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e0ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.954592:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e0ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.954597:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e0ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.954815:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779232.955190:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.955196:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c720bd9/0xb1aa4014e936e0f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.955207:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.955211:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.955215:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c720bd9/0xb1aa4014e936e0f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.955225:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c720bd9/0xb1aa4014e936e0f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.955313:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c720bd9/0xb1aa4014e936e0f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.955322:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c720bd9/0xb1aa4014e936e0f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.956390:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779232.956405:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e0ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.956406:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.956425:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.956429:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e0ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.956440:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e0ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.956457:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e0ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.956463:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e0ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.956508:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.956511:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c720bd9/0xb1aa4014e936e0f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.956519:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ae00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.956522:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c720bd9/0xb1aa4014e936e0f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.956530:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c720bd9/0xb1aa4014e936e0f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.956541:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c720bd9/0xb1aa4014e936e0f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.956547:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c720bd9/0xb1aa4014e936e0f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.956560:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.956561:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.956563:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.956574:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.957432:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.957443:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e0fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.957460:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.957465:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.957472:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e0fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.957487:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e0fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.957497:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e0fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.957505:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e0fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.957542:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779232.958033:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.958105:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003913dc38/0xb1aa4014e936e104 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.958115:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.958119:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.958123:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003913dc38/0xb1aa4014e936e104 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.958133:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003913dc38/0xb1aa4014e936e104 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.958140:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003913dc38/0xb1aa4014e936e104 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.958149:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003913dc38/0xb1aa4014e936e104 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.958173:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790779232.958234:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790779232.958245:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e0fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958256:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779232.958261:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e0fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958287:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e0fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958308:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e0fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958318:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e0fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958344:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779232.958347:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003913dc38/0xb1aa4014e936e104 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958354:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3e00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779232.958356:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003913dc38/0xb1aa4014e936e104 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958363:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003913dc38/0xb1aa4014e936e104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958372:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003913dc38/0xb1aa4014e936e104 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958379:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003913dc38/0xb1aa4014e936e104 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958404:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779232.958406:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779232.958408:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.958502:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779232.958503:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779232.958513:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056bd3565/0xb1aa4014e936e10b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.958525:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.958535:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.958540:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056bd3565/0xb1aa4014e936e10b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.958551:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056bd3565/0xb1aa4014e936e10b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.958561:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056bd3565/0xb1aa4014e936e10b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.958567:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056bd3565/0xb1aa4014e936e10b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.958588:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790779232.958612:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779232.958619:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056bd3565/0xb1aa4014e936e10b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958627:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779232.958631:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056bd3565/0xb1aa4014e936e10b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958643:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056bd3565/0xb1aa4014e936e10b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958657:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056bd3565/0xb1aa4014e936e10b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958665:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056bd3565/0xb1aa4014e936e10b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779232.958682:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779232.958684:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779232.958685:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.960484:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.960501:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e112 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.960522:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.960527:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.960533:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.960548:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.960559:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.960583:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.961556:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.961629:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.961644:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.961679:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.961684:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.961696:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.961716:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e112 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.961723:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e112 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.961751:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.961753:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.961754:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.962296:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.962305:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013c0d08b/0xb1aa4014e936e119 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.962323:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.962329:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.962336:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013c0d08b/0xb1aa4014e936e119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.962350:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013c0d08b/0xb1aa4014e936e119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.962360:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013c0d08b/0xb1aa4014e936e119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.962368:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013c0d08b/0xb1aa4014e936e119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.962394:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.962430:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.962439:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013c0d08b/0xb1aa4014e936e119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.962449:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.962454:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013c0d08b/0xb1aa4014e936e119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.962463:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013c0d08b/0xb1aa4014e936e119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.962489:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013c0d08b/0xb1aa4014e936e119 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.962497:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013c0d08b/0xb1aa4014e936e119 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.962516:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.962518:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.962520:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.962874:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.962910:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936e120 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.962928:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.962932:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.962936:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936e120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.962947:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936e120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.962956:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936e120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.962965:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936e120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.962989:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.963051:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.963058:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936e120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963076:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.963088:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936e120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963100:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936e120 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963226:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936e120 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963234:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936e120 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963266:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.963268:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.963270:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.963406:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.963414:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f341d846/0xb1aa4014e936e127 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.963425:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.963428:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.963432:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f341d846/0xb1aa4014e936e127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.963440:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f341d846/0xb1aa4014e936e127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.963458:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f341d846/0xb1aa4014e936e127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.963466:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f341d846/0xb1aa4014e936e127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.963485:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.963518:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.963526:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f341d846/0xb1aa4014e936e127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963534:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.963538:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f341d846/0xb1aa4014e936e127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963548:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f341d846/0xb1aa4014e936e127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963562:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f341d846/0xb1aa4014e936e127 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963569:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f341d846/0xb1aa4014e936e127 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963586:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.963590:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.963593:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.963750:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.963755:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4dacbb/0xb1aa4014e936e12e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.963761:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.963763:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.963766:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4dacbb/0xb1aa4014e936e12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.963772:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca4dacbb/0xb1aa4014e936e12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.963777:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4dacbb/0xb1aa4014e936e12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.963783:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4dacbb/0xb1aa4014e936e12e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.963804:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.963831:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.963839:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca4dacbb/0xb1aa4014e936e12e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963861:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.963866:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4dacbb/0xb1aa4014e936e12e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963875:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4dacbb/0xb1aa4014e936e12e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963929:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca4dacbb/0xb1aa4014e936e12e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963936:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca4dacbb/0xb1aa4014e936e12e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.963952:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.963954:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.963957:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779232.964103:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.964109:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a903cf5/0xb1aa4014e936e135 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964116:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.964118:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.964121:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a903cf5/0xb1aa4014e936e135 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964127:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a903cf5/0xb1aa4014e936e135 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964132:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a903cf5/0xb1aa4014e936e135 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964137:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a903cf5/0xb1aa4014e936e135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964190:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779232.964502:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.964512:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075432020/0xb1aa4014e936e13c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.964521:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.964527:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a903cf5/0xb1aa4014e936e135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.964536:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.964541:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a903cf5/0xb1aa4014e936e135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.964551:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a903cf5/0xb1aa4014e936e135 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964568:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=550s v=(0 0) 00010000:00010000:3.0:1790779232.964574:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a903cf5/0xb1aa4014e936e135 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964576:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.964581:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075432020/0xb1aa4014e936e13c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.964583:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a903cf5/0xb1aa4014e936e135 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964591:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075432020/0xb1aa4014e936e13c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964600:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075432020/0xb1aa4014e936e13c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964608:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075432020/0xb1aa4014e936e13c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964624:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779232.964843:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.964847:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075432020/0xb1aa4014e936e13c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779232.964859:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.964865:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029842f21/0xb1aa4014e936e143 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964873:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.964876:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.964899:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029842f21/0xb1aa4014e936e143 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964909:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029842f21/0xb1aa4014e936e143 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964917:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029842f21/0xb1aa4014e936e143 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964930:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029842f21/0xb1aa4014e936e143 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.964938:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779232.965282:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.965288:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7666da0/0xb1aa4014e936e14a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965296:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.965299:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.965303:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7666da0/0xb1aa4014e936e14a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965311:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7666da0/0xb1aa4014e936e14a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965319:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7666da0/0xb1aa4014e936e14a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965326:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7666da0/0xb1aa4014e936e14a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965335:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790779232.965589:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.965595:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e151 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965608:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.965611:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.965615:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e151 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965624:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e151 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965632:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e151 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965640:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e151 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965647:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790779232.965906:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779232.965912:0:19170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5abc34e/0xb1aa4014e936e158 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965920:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1790779232.965923:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779232.965927:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5abc34e/0xb1aa4014e936e158 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965936:0:19170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5abc34e/0xb1aa4014e936e158 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965956:0:19170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5abc34e/0xb1aa4014e936e158 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965963:0:19170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5abc34e/0xb1aa4014e936e158 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779232.965971:0:19170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1790779232.966000:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671e00 already unused, calling callback (ffffffffc0c17ac0) 00002000:00080000:2.0:1790779232.966000:0:19170:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:3.0:1790779232.966005:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075432020/0xb1aa4014e936e13c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966013:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075432020/0xb1aa4014e936e13c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966027:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075432020/0xb1aa4014e936e13c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966033:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075432020/0xb1aa4014e936e13c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966054:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790779232.966059:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029842f21/0xb1aa4014e936e143 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966083:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.966087:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029842f21/0xb1aa4014e936e143 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966095:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029842f21/0xb1aa4014e936e143 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966106:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029842f21/0xb1aa4014e936e143 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966112:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029842f21/0xb1aa4014e936e143 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966124:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790779232.966127:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7666da0/0xb1aa4014e936e14a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966133:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602670c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.966136:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7666da0/0xb1aa4014e936e14a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966143:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7666da0/0xb1aa4014e936e14a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966151:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7666da0/0xb1aa4014e936e14a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966163:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7666da0/0xb1aa4014e936e14a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966174:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779232.966177:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e151 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779232.966182:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17173:x1877767663848192:12345-0@lo:5:osp-pre-1-0.0 Request processed in 71588us (71645us total) trans 0 rc 0/0 00010000:00010000:3.0:1790779232.966184:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602670400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.966187:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e151 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966194:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779232.966194:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1790779232.966203:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e151 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966210:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e151 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966481:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779232.966485:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5abc34e/0xb1aa4014e936e158 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966493:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779232.966502:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5abc34e/0xb1aa4014e936e158 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966511:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5abc34e/0xb1aa4014e936e158 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966534:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5abc34e/0xb1aa4014e936e158 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966542:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5abc34e/0xb1aa4014e936e158 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779232.966556:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.966558:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.966560:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779232.966583:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779232.966642:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17173:1877767663848192:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790779232.966664:0:17173:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1790779232.966723:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17173:1877767663848448:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790779232.966769:0:17173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779232.966813:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b71c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779232.966863:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663848448 00000100:00100000:2.0:1790779232.966870:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663848448 00000100:00100000:2.0:1790779232.966930:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790779232.966937:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17173:x1877767663848448:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1790779232.966980:0:18654:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1790779232.970518:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17173:x1877767663848448:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3570us (3739us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790779232.970535:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790779232.970723:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17173:1877767663848448:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790779232.970745:0:17173:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:3.0:1790779233.265562:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790779233.834610:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790779234.266764:0:19822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790779234.858550:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790779235.370375:0:19875:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790779235.370576:0:19875:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790779235.880497:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779235.945219:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663848576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779235.945291:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779235.945368:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663848576 00000100:00100000:2.0:1790779235.945376:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663848576 00000100:00100000:2.0:1790779235.945437:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790779235.945445:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663848576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790779235.945473:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790779235.945517:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663848576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779235.945525:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1790779235.946026:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779235.946075:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663848576:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1790779236.387783:0:19925:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790779236.388018:0:19925:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790779236.890419:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779236.890589:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642795008 00000100:00100000:2.0:1790779236.890600:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642795008 00000100:00100000:2.0:1790779236.890648:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:2.0:1790779236.890657:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1877767642795008:12345-192.168.203.3@tcp:250:mount.lustre.0 00010000:00080000:2.0:1790779236.890685:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b53cdbc3-122f-46dd-b58e-9b4de37f59c6@192.168.203.3@tcp t0 exp 0000000000000000 cur 554 last 0 00000020:00000080:2.0:1790779236.890787:0:17140:0:(genops.c:1384:class_connect()) connect: client b53cdbc3-122f-46dd-b58e-9b4de37f59c6, cookie 0xb1aa4014e936e15f 00000100:00080000:3.0:1790779236.903681:0:17140:0:(import.c:65:import_set_state_nolock()) ffff9b760342c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779236.903775:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+5:2397:x1877767642795008:12345-192.168.203.3@tcp:250:mount.lustre.0 Request processed in 13116us (13365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779236.903786:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 114 00010000:00010000:2.0:1790779236.904752:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779236.909753:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779236.910081:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642795136 00000100:00100000:3.0:1790779236.910093:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642795136 00000100:00100000:3.0:1790779236.910155:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:3.0:1790779236.910165:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+5:14873:x1877767642795136:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790779236.910181:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779236.910199:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701663200/0xb1aa4014e936e166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b69 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779236.910227:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701663200/0xb1aa4014e936e166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b69 expref: 6 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779236.910249:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701663200/0xb1aa4014e936e166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b69 expref: 6 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779236.910259:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663200, rc 0) 00000100:00100000:3.0:1790779236.910321:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+6:14873:x1877767642795136:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 157us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779236.910328:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:0.0:1790779236.919531:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779236.919654:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642795264 00000100:00100000:3.0:1790779236.919663:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642795264 00000100:00100000:3.0:1790779236.919727:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:3.0:1790779236.919737:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+6:14873:x1877767642795264:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790779236.919853:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+6:14873:x1877767642795264:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 117us (330us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790779236.919875:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:1.0:1790779236.922372:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779236.922542:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642795392 00000100:00100000:0.0:1790779236.922552:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642795392 00000100:00100000:0.0:1790779236.922646:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:0.0:1790779236.922657:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+6:14873:x1877767642795392:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790779236.922674:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779236.922694:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768600/0xb1aa4014e936e16d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425b70 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779236.922735:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768600/0xb1aa4014e936e16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b70 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779236.922746:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768600/0xb1aa4014e936e16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b70 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779236.922754:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768600, rc 0) 00000100:00100000:0.0:1790779236.922810:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+7:14873:x1877767642795392:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 157us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779236.922817:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:2.0:1790779236.935654:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779236.936642:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642795520 00000100:00100000:0.0:1790779236.936654:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642795520 00000100:00100000:0.0:1790779236.936726:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:0.0:1790779236.936736:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+7:14873:x1877767642795520:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790779236.936924:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+8:14873:x1877767642795520:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 187us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779236.936945:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:1.0:1790779236.947677:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779236.948311:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642795648 00000100:00100000:0.0:1790779236.948323:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642795648 00000100:00100000:0.0:1790779236.948646:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:0.0:1790779236.948658:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+8:14873:x1877767642795648:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790779236.948828:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+8:14873:x1877767642795648:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 170us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779236.948837:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:1.0:1790779236.964658:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779236.964786:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642795776 00000100:00100000:3.0:1790779236.964797:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642795776 00000100:00100000:3.0:1790779236.964856:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:3.0:1790779236.964866:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+8:14891:x1877767642795776:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779236.965431:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+8:14891:x1877767642795776:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 565us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779236.965441:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:3.0:1790779236.969295:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663848704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779236.969374:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779236.969462:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663848704 00000100:00100000:3.0:1790779236.969470:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663848704 00000100:00100000:3.0:1790779236.969524:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790779236.969533:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663848704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790779236.969554:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790779236.969596:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663848704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779236.969603:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1790779236.969625:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779236.969661:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663848704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779237.005628:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779237.005734:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642795904 00000100:00100000:0.0:1790779237.005744:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642795904 00000100:00100000:0.0:1790779237.005803:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:0.0:1790779237.005814:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+8:14891:x1877767642795904:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790779237.006018:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+8:14891:x1877767642795904:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 205us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.006026:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:1.0:1790779237.012590:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779237.012680:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642796032 00000100:00100000:2.0:1790779237.012690:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642796032 00000100:00100000:2.0:1790779237.012744:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:2.0:1790779237.012751:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+8:14891:x1877767642796032:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779237.012927:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+8:14891:x1877767642796032:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 175us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779237.012935:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:1.0:1790779237.025314:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779237.025417:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642796160 00000100:00100000:3.0:1790779237.025428:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642796160 00000100:00100000:3.0:1790779237.025497:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:3.0:1790779237.025506:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+8:14873:x1877767642796160:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790779237.025521:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779237.025537:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701662000/0xb1aa4014e936e174 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ba1 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779237.025581:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701662000/0xb1aa4014e936e174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba1 expref: 9 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779237.025601:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701662000/0xb1aa4014e936e174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba1 expref: 9 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779237.025609:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662000, rc 0) 00000100:00100000:3.0:1790779237.025661:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+9:14873:x1877767642796160:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 156us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779237.025668:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:0.0:1790779237.034101:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779237.034241:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642796288 00000100:00100000:3.0:1790779237.034252:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642796288 00000100:00100000:3.0:1790779237.034308:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:3.0:1790779237.034318:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+9:14873:x1877767642796288:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790779237.034343:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790779237.034369:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790779237.034373:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790779237.034376:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790779237.034378:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790779237.034381:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1790779237.043215:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+9:14873:x1877767642796288:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 8889us (9117us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779237.043237:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:1.0:1790779237.054268:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779237.054344:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642796416 00000100:00100000:3.0:1790779237.054355:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642796416 00000100:00100000:3.0:1790779237.054410:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:3.0:1790779237.054419:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+9:14873:x1877767642796416:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790779237.054459:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779237.054478:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e17b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ba8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779237.054504:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e17b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba8 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779237.054515:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e17b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba8 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779237.054524:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2800, rc 0) 00000100:00100000:3.0:1790779237.054576:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+10:14873:x1877767642796416:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 158us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779237.054583:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:0.0:1790779237.061982:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779237.062073:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642796544 00000100:00100000:3.0:1790779237.062083:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642796544 00000100:00100000:3.0:1790779237.062137:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:3.0:1790779237.062146:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+10:14873:x1877767642796544:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790779237.063540:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+10:14873:x1877767642796544:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 1389us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779237.063552:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:1.0:1790779237.066580:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779237.070901:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642796672 00000100:00100000:3.0:1790779237.070915:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642796672 00000100:00100000:2.0:1790779237.071365:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:2.0:1790779237.071374:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+10:14873:x1877767642796672:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790779237.071660:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+10:14873:x1877767642796672:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 286us (5089us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779237.071674:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:1.0:1790779237.095113:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779237.097198:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642796800 00000100:00100000:3.0:1790779237.097212:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642796800 00000100:00100000:3.0:1790779237.097331:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:3.0:1790779237.097341:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+10:14897:x1877767642796800:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790779237.097961:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+10:14897:x1877767642796800:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 620us (2856us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779237.097970:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:0.0:1790779237.112929:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779237.115150:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642796928 00000100:00100000:2.0:1790779237.115165:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642796928 00000100:00100000:2.0:1790779237.115247:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:2.0:1790779237.115258:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+10:14897:x1877767642796928:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779237.115420:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+10:14897:x1877767642796928:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 163us (2500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779237.115429:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:1.0:1790779237.126327:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779237.126724:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642797056 00000100:00100000:0.0:1790779237.126733:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642797056 00000100:00100000:0.0:1790779237.126776:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1790779237.126795:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1877767642797056:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790779237.126827:0:17146:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0e04fb1a-50ac-430a-9a7f-cdeca654586e@192.168.203.3@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:0.0:1790779237.126871:0:17146:0:(genops.c:1384:class_connect()) connect: client 0e04fb1a-50ac-430a-9a7f-cdeca654586e, cookie 0xb1aa4014e936e182 00000004:00100000:0.0:1790779237.126920:0:17146:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790779237.127144:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9b7603412000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779237.127210:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2397:x1877767642797056:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 425us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.127218:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1790779237.127798:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779237.127896:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642797312 00000100:00100000:0.0:1790779237.127902:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642797312 00000100:00100000:0.0:1790779237.127930:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:0.0:1790779237.127935:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1877767642797312:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790779237.127955:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 0e04fb1a-50ac-430a-9a7f-cdeca654586e@192.168.203.3@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:0.0:1790779237.127987:0:17147:0:(genops.c:1384:class_connect()) connect: client 0e04fb1a-50ac-430a-9a7f-cdeca654586e, cookie 0xb1aa4014e936e189 00000004:00100000:0.0:1790779237.128002:0:17147:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790779237.128159:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9b7603410800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779237.128190:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2397:x1877767642797312:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 254us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.128198:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:1.0:1790779237.162756:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779237.162791:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779237.162909:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779237.162944:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642797568 00000100:00100000:1.0:1790779237.162953:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642797568 00000100:00100000:0.0:1790779237.162986:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642797184 00000100:00100000:0.0:1790779237.162993:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642797184 00000100:00100000:1.0:1790779237.163003:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642797440 00000100:00100000:1.0:1790779237.163008:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642797440 00000100:00100000:0.0:1790779237.163027:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00080000:2.0:1790779237.163161:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779237.163166:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779237.163255:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:14873:x1877767642797568:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790779237.163295:0:17147:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790779237.163379:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:14873:x1877767642797568:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 343us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.168679:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1790779237.168724:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1790779237.168741:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:0:x1877767642797184:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790779237.170534:0:17147:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790779237.170618:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:0:x1877767642797184:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 1881us (7822us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.170627:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1790779237.170654:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1790779237.170665:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:0:x1877767642797440:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790779237.170693:0:17147:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790779237.170736:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:0:x1877767642797440:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 76us (7828us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.170743:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:1.0:1790779237.180491:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779237.180607:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642797696 00000100:00100000:3.0:1790779237.180617:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642797696 00000100:00100000:3.0:1790779237.180671:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1790779237.180680:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:14873:x1877767642797696:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790779237.180758:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:14873:x1877767642797696:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 79us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779237.180764:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:1.0:1790779237.186568:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779237.186602:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779237.186632:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779237.186713:0:17157:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642798080 00000100:00100000:2.0:1790779237.186722:0:17157:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642798080 00000100:00100000:2.0:1790779237.186765:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:2.0:1790779237.186774:0:17157:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:14873:x1877767642798080:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:2.0:1790779237.186840:0:17157:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:14873:x1877767642798080:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 68us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779237.186847:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1790779237.190776:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642797824 00000100:00100000:0.0:1790779237.190790:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642797824 00000100:00100000:0.0:1790779237.190837:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642797952 00000100:00100000:0.0:1790779237.190839:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642797952 00000100:00100000:0.0:1790779237.190859:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:0.0:1790779237.190868:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1877767642797824:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790779237.190914:0:19170:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0e04fb1a-50ac-430a-9a7f-cdeca654586e@192.168.203.3@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:0.0:1790779237.190943:0:19170:0:(genops.c:1384:class_connect()) connect: client 0e04fb1a-50ac-430a-9a7f-cdeca654586e, cookie 0xb1aa4014e936e190 00002000:00100000:0.0:1790779237.190963:0:19170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0e04fb1a-50ac-430a-9a7f-cdeca654586e/ffff9b77208af800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790779237.190982:0:19170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790779237.191187:0:19170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790779237.191218:0:19170:0:(import.c:65:import_set_state_nolock()) ffff9b772012e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779237.191294:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2397:x1877767642797824:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 426us (4691us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.191302:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:0.0:1790779237.191323:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:0.0:1790779237.191328:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1877767642797952:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790779237.191343:0:19170:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0e04fb1a-50ac-430a-9a7f-cdeca654586e@192.168.203.3@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:0.0:1790779237.191357:0:19170:0:(genops.c:1384:class_connect()) connect: client 0e04fb1a-50ac-430a-9a7f-cdeca654586e, cookie 0xb1aa4014e936e197 00002000:00100000:0.0:1790779237.191361:0:19170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0e04fb1a-50ac-430a-9a7f-cdeca654586e/ffff9b772012f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790779237.191372:0:19170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790779237.191456:0:19170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790779237.191471:0:19170:0:(import.c:65:import_set_state_nolock()) ffff9b772012a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779237.191491:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2397:x1877767642797952:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 162us (4859us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.191498:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1790779237.194861:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779237.194973:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642798208 00000100:00100000:3.0:1790779237.194983:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642798208 00000100:00100000:3.0:1790779237.195040:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1790779237.195050:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:14873:x1877767642798208:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00080000:3.0:1790779237.201144:0:17149:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6008us 00000004:00200000:2.0:1790779237.210614:0:17149:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790779237.210737:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:14873:x1877767642798208:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 15684us (15879us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779237.210751:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1790779237.388520:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779237.389092:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642798336 00000100:00100000:2.0:1790779237.389106:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642798336 00000100:00100000:2.0:1790779237.389191:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:2.0:1790779237.389202:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:14920:x1877767642798336:12345-192.168.203.3@tcp:101:mkdir.0 00010000:00010000:2.0:1790779237.389250:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779237.389291:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671200/0xb1aa4014e936e19e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425bd9 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779237.389377:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670000/0xb1aa4014e936e1a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779237.389394:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670000/0xb1aa4014e936e1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779237.389411:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670000/0xb1aa4014e936e1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779237.389468:0:17147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790779237.389472:0:17147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779237.389524:0:17147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670000/0xb1aa4014e936e1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779237.389558:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671200/0xb1aa4014e936e19e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425bd9 expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779237.389582:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670000/0xb1aa4014e936e1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425bd9 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779237.389592:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a99100) 00010000:00010000:2.0:1790779237.389595:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779237.389598:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602670000, rc 0) 00000100:00100000:2.0:1790779237.389690:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:14920:x1877767642798336:12345-192.168.203.3@tcp:101:mkdir.0 Request processed in 490us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779237.389698:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:1.0:1790779237.487264:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663848832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779237.487382:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779237.487513:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779237.487548:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663848960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779237.487583:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779237.487826:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663848832 00000100:00100000:3.0:1790779237.487837:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663848832 00000100:00100000:3.0:1790779237.487937:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663848960 00000100:00100000:3.0:1790779237.487941:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663848960 00000100:00100000:3.0:1790779237.487961:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790779237.487971:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663848832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790779237.488008:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790779237.488097:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663848832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779237.488106:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790779237.488122:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790779237.488137:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663848960:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779237.488467:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663848832:0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779237.488550:0:18106:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790779237.488666:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663848960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 534us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.488673:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790779237.488742:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663848960:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790779237.928436:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779237.993533:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663849216:0@lo:400:kworker.0 00000100:00100000:3.0:1790779237.993622:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779237.993680:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663849728:0@lo:400:kworker.0 00000100:00100000:3.0:1790779237.993700:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779237.993716:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663850240:0@lo:400:kworker.0 00000100:00100000:3.0:1790779237.993744:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779237.993773:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1790779237.993779:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663849088:0@lo:400:kworker.0 00000100:00100000:3.0:1790779237.993807:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779237.993826:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663849600:0@lo:400:kworker.0 00000100:00100000:3.0:1790779237.993843:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779237.993856:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663850112:0@lo:400:kworker.0 00000100:00100000:3.0:1790779237.993872:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779237.993915:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663850624:0@lo:400:kworker.0 00000100:00100000:3.0:1790779237.993933:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779237.994238:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663850240 00000100:00100000:0.0:1790779237.994250:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663850240 00000100:00080000:2.0:1790779237.994303:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779237.994309:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663849600 00000100:00100000:2.0:1790779237.994311:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779237.994311:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663849600 00000100:00100000:2.0:1790779237.994321:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663850752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779237.994324:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663850112 00000100:00100000:0.0:1790779237.994326:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663850112 00000100:00100000:0.0:1790779237.994337:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663850624 00000100:00100000:0.0:1790779237.994339:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663850624 00000100:00100000:2.0:1790779237.994356:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779237.994362:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790779237.994454:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663849344:0@lo:400:kworker.0 00000100:00100000:1.0:1790779237.994491:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779237.994516:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663849856:0@lo:400:kworker.0 00000100:00100000:1.0:1790779237.994548:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779237.994565:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663850368:0@lo:400:kworker.0 00000100:00100000:1.0:1790779237.994586:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779237.994599:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790779237.994605:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663849472:0@lo:400:kworker.0 00000100:00100000:1.0:1790779237.994624:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779237.994642:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663849984:0@lo:400:kworker.0 00000100:00100000:1.0:1790779237.994674:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779237.994691:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663850496:0@lo:400:kworker.0 00000100:00100000:1.0:1790779237.994713:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779237.994755:0:17146:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790779237.994766:0:17146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1790779237.994804:0:17147:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790779237.994811:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663850368 00000100:00100000:3.0:1790779237.994814:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663850368 00000100:00100000:3.0:1790779237.994835:0:17147:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790779237.994840:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663850496 00000100:00100000:3.0:1790779237.994842:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663850496 00000100:00100000:3.0:1790779237.994854:0:17147:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790779237.994860:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790779237.994867:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663849600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779237.994968:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663849600:12345-0@lo:400:kworker.0 Request processed in 101us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779237.994984:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790779237.995101:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663850240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779237.995144:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663850240:12345-0@lo:400:kworker.0 Request processed in 757us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.995151:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790779237.995167:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790779237.995173:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663850112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779237.995201:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663850112:12345-0@lo:400:kworker.0 Request processed in 28us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.995206:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790779237.995217:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790779237.995223:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663850624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779237.995250:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663850624:12345-0@lo:400:kworker.0 Request processed in 28us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.995256:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790779237.995266:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790779237.995272:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663850368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779237.995298:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663850368:12345-0@lo:400:kworker.0 Request processed in 27us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.995303:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790779237.995316:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790779237.995322:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663850496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779237.995347:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663850496:12345-0@lo:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.995353:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790779237.995374:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663849216 00000100:00100000:0.0:1790779237.995385:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663849216 00000100:00100000:0.0:1790779237.995413:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663849728 00000100:00100000:0.0:1790779237.995415:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663849728 00000100:00100000:0.0:1790779237.995428:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790779237.995434:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663849216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779237.995469:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663849216:12345-0@lo:400:kworker.0 Request processed in 35us (1847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.995475:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790779237.995486:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790779237.995491:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663849728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779237.995540:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663849728:12345-0@lo:400:kworker.0 Request processed in 48us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779237.995546:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790779237.995565:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790779237.995576:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663850880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779237.995603:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779237.995742:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663849088 00000100:00100000:3.0:1790779237.995747:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663849088 00000100:00100000:3.0:1790779237.995780:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790779237.995787:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3650:x1877767663849088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779237.995821:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3650:x1877767663849088:12345-0@lo:400:kworker.0 Request processed in 35us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779237.995827:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790779238.002070:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663850752 00000100:00100000:0.0:1790779238.002092:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663850752 00000100:00100000:0.0:1790779238.002163:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663850880 00000100:00100000:0.0:1790779238.002167:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663850880 00000100:00100000:0.0:1790779238.002196:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790779238.002210:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663850752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779238.002248:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779238.002364:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663850752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 157us (8006us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779238.002371:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790779238.002391:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790779238.002397:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663850880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779238.002427:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779238.002487:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663850880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (6883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779238.002494:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790779238.002573:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663850880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779238.002643:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663849344 00000100:00100000:0.0:1790779238.002647:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663849344 00000100:00100000:0.0:1790779238.002673:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663849856 00000100:00100000:0.0:1790779238.002678:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663849856 00000100:00100000:0.0:1790779238.002690:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663849472 00000100:00100000:0.0:1790779238.002693:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663849472 00000100:00100000:0.0:1790779238.002702:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663849984 00000100:00100000:0.0:1790779238.002705:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663849984 00000100:00100000:0.0:1790779238.002717:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790779238.002723:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663849344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779238.002777:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663849344:12345-0@lo:400:kworker.0 Request processed in 54us (8285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779238.002784:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790779238.002797:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790779238.002804:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663849856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779238.002835:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663849856:12345-0@lo:400:kworker.0 Request processed in 33us (8287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779238.002841:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790779238.002850:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779238.002855:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663849472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779238.002863:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663849088:0@lo:400:kworker.0 00000100:00100000:3.0:1790779238.002897:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663849600:0@lo:400:kworker.0 00000100:00100000:0.0:1790779238.002899:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663849472:12345-0@lo:400:kworker.0 Request processed in 44us (8274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779238.002912:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663850112:0@lo:400:kworker.0 00000100:00100000:0.0:1790779238.002912:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779238.002923:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790779238.002929:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663849984:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1790779238.002931:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603009f80 x1877767663850624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779238.002958:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663849984:12345-0@lo:400:kworker.0 Request processed in 30us (8283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779238.002964:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790779238.003149:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663850624:0@lo:400:kworker.0 00000100:00080000:0.0:1790779238.003162:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790779238.003167:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779238.003169:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663849216:0@lo:400:kworker.0 00000100:00080000:0.0:1790779238.003170:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779238.003173:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790779238.003182:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663849728:0@lo:400:kworker.0 00000100:00100000:3.0:1790779238.003198:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663850240:0@lo:400:kworker.0 00000100:00100000:2.0:1790779238.010023:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663850752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779238.010180:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663849472:0@lo:400:kworker.0 00000100:00100000:1.0:1790779238.010195:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663849984:0@lo:400:kworker.0 00000100:00100000:1.0:1790779238.010209:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663850496:0@lo:400:kworker.0 00000100:00100000:1.0:1790779238.010221:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663849344:0@lo:400:kworker.0 00000100:00100000:1.0:1790779238.010233:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663849856:0@lo:400:kworker.0 00010000:00080000:1.0:1790779238.010273:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760300ad80 x1877767663850368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779238.010285:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663850368:0@lo:400:kworker.0 00000040:00080000:2.0:1790779238.570369:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779238.953668:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790779239.028593:0:19466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000001:00080000:2.0:1790779239.028614:0:19466:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1790779239.409388:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779239.409487:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642798464 00000100:00100000:0.0:1790779239.409497:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642798464 00000100:00100000:0.0:1790779239.409587:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1790779239.409600:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:14973:x1877767642798464:12345-192.168.203.3@tcp:41:lfs.0 00000004:00000024:0.0:1790779239.409639:0:17148:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790779239.409762:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:14973:x1877767642798464:12345-192.168.203.3@tcp:41:lfs.0 Request processed in 165us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779239.409769:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00080000:2.0:1790779239.409908:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779239.420418:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779239.420493:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642798592 00000100:00100000:3.0:1790779239.420512:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642798592 00000100:00100000:3.0:1790779239.420633:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1790779239.420644:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:14973:x1877767642798592:12345-192.168.203.3@tcp:41:lfs.0 00000004:00000024:3.0:1790779239.420683:0:17146:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790779239.420805:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:14973:x1877767642798592:12345-192.168.203.3@tcp:41:lfs.0 Request processed in 162us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.420812:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00080000:2.0:1790779239.424397:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779239.433468:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779239.433757:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642798720 00000100:00100000:0.0:1790779239.433767:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642798720 00000100:00100000:0.0:1790779239.433842:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1790779239.433851:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:14973:x1877767642798720:12345-192.168.203.3@tcp:13:lfs.0 00002000:00000024:0.0:1790779239.433907:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790779239.434010:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:14973:x1877767642798720:12345-192.168.203.3@tcp:13:lfs.0 Request processed in 160us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779239.434026:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00080000:2.0:1790779239.434959:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779239.437791:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779239.437913:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642798848 00000100:00100000:0.0:1790779239.437924:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642798848 00000100:00100000:0.0:1790779239.438014:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:0.0:1790779239.438061:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:14973:x1877767642798848:12345-192.168.203.3@tcp:13:lfs.0 00002000:00000024:0.0:1790779239.438171:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779239.438317:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:14973:x1877767642798848:12345-192.168.203.3@tcp:13:lfs.0 Request processed in 258us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779239.438326:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00080000:2.0:1790779239.439359:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779239.766802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779239.766906:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642798976 00000100:00100000:2.0:1790779239.766916:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642798976 00000100:00100000:2.0:1790779239.766977:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:2.0:1790779239.766996:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+10:15006:x1877767642798976:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790779239.767021:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779239.767039:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e1ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425be0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779239.767068:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425be0 expref: 11 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779239.767080:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425be0 expref: 11 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779239.767090:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602671200, rc 0) 00000100:00100000:2.0:1790779239.767160:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15006:x1877767642798976:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 174us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779239.767168:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:1.0:1790779239.769191:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779239.769267:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642799104 00000100:00100000:3.0:1790779239.769276:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642799104 00000100:00100000:3.0:1790779239.769328:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:3.0:1790779239.769338:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15006:x1877767642799104:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790779239.769594:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15006:x1877767642799104:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 257us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.769602:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:1.0:1790779239.779003:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779239.779138:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642799232 00000100:00100000:3.0:1790779239.779148:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642799232 00000100:00100000:3.0:1790779239.779207:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:3.0:1790779239.779217:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15006:x1877767642799232:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790779239.779382:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15006:x1877767642799232:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 166us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.779392:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:1.0:1790779239.811453:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779239.811543:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642799360 00000100:00100000:3.0:1790779239.811554:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642799360 00000100:00100000:3.0:1790779239.811612:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:3.0:1790779239.811621:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15011:x1877767642799360:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790779239.811768:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15011:x1877767642799360:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 148us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.811776:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:1.0:1790779239.834118:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779239.835146:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642799488 00000100:00100000:2.0:1790779239.835157:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642799488 00000100:00100000:2.0:1790779239.835218:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:2.0:1790779239.835227:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15011:x1877767642799488:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779239.835373:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15011:x1877767642799488:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 146us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779239.835381:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:1.0:1790779239.838634:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779239.838759:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642799616 00000100:00100000:0.0:1790779239.838769:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642799616 00000100:00100000:0.0:1790779239.838821:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:0.0:1790779239.838829:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15011:x1877767642799616:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790779239.838983:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15011:x1877767642799616:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 154us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779239.838991:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:1.0:1790779239.848552:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779239.848610:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642799744 00000100:00100000:3.0:1790779239.848633:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642799744 00000100:00100000:3.0:1790779239.849118:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:3.0:1790779239.849130:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:15006:x1877767642799744:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790779239.849149:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779239.849166:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936e1b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c11 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779239.849194:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936e1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c11 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779239.849206:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936e1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c11 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779239.849214:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3e00, rc 0) 00000100:00100000:3.0:1790779239.849409:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:15006:x1877767642799744:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 281us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.849417:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:1.0:1790779239.855246:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779239.856642:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642799872 00000100:00100000:2.0:1790779239.856657:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642799872 00000100:00100000:2.0:1790779239.856728:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:2.0:1790779239.856739:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:15006:x1877767642799872:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790779239.856768:0:17141:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790779239.856794:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790779239.856799:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790779239.856802:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790779239.856805:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790779239.856807:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1790779239.859979:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:15006:x1877767642799872:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 3232us (4735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779239.859993:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:1.0:1790779239.864978:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779239.865150:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642800000 00000100:00100000:3.0:1790779239.865161:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642800000 00000100:00100000:3.0:1790779239.865217:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:3.0:1790779239.865228:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:15006:x1877767642800000:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790779239.865245:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779239.865263:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e1ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c18 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779239.865291:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e1ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c18 expref: 13 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779239.865302:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e1ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c18 expref: 13 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779239.865325:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3600, rc 0) 00000100:00100000:3.0:1790779239.865383:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:15006:x1877767642800000:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 157us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.865391:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:1.0:1790779239.867971:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779239.868115:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642800128 00000100:00100000:2.0:1790779239.868125:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642800128 00000100:00100000:2.0:1790779239.868180:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:2.0:1790779239.868190:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ba30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:15006:x1877767642800128:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790779239.868371:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ba30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:15006:x1877767642800128:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 181us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779239.868379:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:1.0:1790779239.874853:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779239.874969:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642800256 00000100:00100000:0.0:1790779239.874978:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642800256 00000100:00100000:0.0:1790779239.875050:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:0.0:1790779239.875058:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:15006:x1877767642800256:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790779239.875205:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:15006:x1877767642800256:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 147us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779239.875213:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:1.0:1790779239.882270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779239.882596:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642800384 00000100:00100000:3.0:1790779239.882606:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642800384 00000100:00100000:3.0:1790779239.882677:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:3.0:1790779239.882687:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:15017:x1877767642800384:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790779239.882843:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:15017:x1877767642800384:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 157us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.882852:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:1.0:1790779239.901774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779239.901914:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642800512 00000100:00100000:2.0:1790779239.901924:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642800512 00000100:00100000:2.0:1790779239.901977:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:2.0:1790779239.902133:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:15017:x1877767642800512:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779239.902279:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:15017:x1877767642800512:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 150us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779239.902287:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:1.0:1790779239.926108:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779239.926147:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779239.926172:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779239.926203:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779239.926220:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779239.926252:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779239.927151:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642800640 00000100:00100000:3.0:1790779239.927161:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642800640 00000100:00100000:3.0:1790779239.927191:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642800896 00000100:00100000:3.0:1790779239.927194:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642800896 00000100:00100000:3.0:1790779239.927201:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642801408 00000100:00100000:3.0:1790779239.927203:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642801408 00000100:00100000:3.0:1790779239.927224:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642801280 00000100:00100000:3.0:1790779239.927226:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642801280 00000100:00100000:3.0:1790779239.927242:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:3.0:1790779239.927250:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2400:x1877767642801408:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779239.927334:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2400:x1877767642801408:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 84us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.927350:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:3.0:1790779239.927367:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1790779239.927374:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:2400:x1877767642801280:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779239.927412:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:2400:x1877767642801280:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 40us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.927419:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1790779239.927433:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1790779239.927437:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1877767642800640:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790779239.927460:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 10cb4944-c4c7-43b5-9787-d954585b459c@192.168.203.3@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1790779239.927495:0:17147:0:(genops.c:1384:class_connect()) connect: client 10cb4944-c4c7-43b5-9787-d954585b459c, cookie 0xb1aa4014e936e1c1 00000004:00100000:3.0:1790779239.927518:0:17147:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790779239.927614:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9b773c025800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779239.927644:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+6:2397:x1877767642800640:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 205us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.927651:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1790779239.927919:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1790779239.927925:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1877767642800896:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790779239.927943:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 10cb4944-c4c7-43b5-9787-d954585b459c@192.168.203.3@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1790779239.927966:0:17147:0:(genops.c:1384:class_connect()) connect: client 10cb4944-c4c7-43b5-9787-d954585b459c, cookie 0xb1aa4014e936e1c8 00000004:00100000:3.0:1790779239.927977:0:17147:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790779239.928198:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9b773c026000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779239.928225:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+6:2397:x1877767642800896:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 298us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.928232:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:0.0:1790779239.928323:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642801664 00000100:00100000:0.0:1790779239.928329:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642801664 00000100:00100000:0.0:1790779239.928368:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642801536 00000100:00100000:0.0:1790779239.928372:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642801536 00000100:00100000:0.0:1790779239.928407:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1790779239.928413:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642801664:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779239.928442:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642801664:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779239.928449:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1790779239.928462:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1790779239.928468:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2400:x1877767642801536:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779239.928490:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2400:x1877767642801536:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779239.928497:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:1.0:1790779239.949726:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779239.949781:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779239.949813:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779239.950165:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642801152 00000100:00100000:2.0:1790779239.950175:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642801152 00000100:00100000:2.0:1790779239.950246:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642801024 00000100:00100000:2.0:1790779239.950250:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642801024 00000100:00100000:2.0:1790779239.950267:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642800768 00000100:00100000:2.0:1790779239.950269:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642800768 00000100:00100000:2.0:1790779239.950283:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1790779239.950292:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+7:15006:x1877767642801152:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790779239.950322:0:17146:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790779239.950396:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+7:15006:x1877767642801152:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 105us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779239.950404:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1790779239.950421:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:2.0:1790779239.950427:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:0:x1877767642801024:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790779239.950439:0:17146:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790779239.950475:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:0:x1877767642801024:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 47us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779239.950482:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:2.0:1790779239.950494:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1790779239.950500:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:0:x1877767642800768:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790779239.950511:0:17146:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790779239.950532:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:0:x1877767642800768:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 33us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779239.950538:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00080000:1.0:1790779239.951209:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790779239.951214:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779239.957697:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779239.957857:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642801792 00000100:00100000:2.0:1790779239.957866:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642801792 00000100:00100000:2.0:1790779239.957943:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1790779239.957953:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:15006:x1877767642801792:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790779239.958047:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:15006:x1877767642801792:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 95us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779239.958055:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1790779239.965088:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779239.965127:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779239.965192:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779239.965241:0:17157:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642802176 00000100:00100000:0.0:1790779239.965249:0:17157:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642802176 00000100:00100000:0.0:1790779239.965302:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1790779239.965311:0:17157:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10cb4944-c4c7-43b5-9787-d954585b459c+6:15006:x1877767642802176:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790779239.965388:0:17157:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10cb4944-c4c7-43b5-9787-d954585b459c+6:15006:x1877767642802176:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779239.965395:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:2.0:1790779239.968466:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779239.968592:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642802304 00000100:00100000:1.0:1790779239.968601:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642802304 00000100:00100000:1.0:1790779239.968652:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:1.0:1790779239.968660:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10cb4944-c4c7-43b5-9787-d954585b459c+6:15006:x1877767642802304:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790779239.968748:0:17150:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790779239.968817:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10cb4944-c4c7-43b5-9787-d954585b459c+6:15006:x1877767642802304:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 157us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779239.968823:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:3.0:1790779239.969417:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642801920 00000100:00100000:3.0:1790779239.969424:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642801920 00000100:00100000:3.0:1790779239.969464:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642802048 00000100:00100000:3.0:1790779239.969482:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642802048 00000100:00100000:3.0:1790779239.969513:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1790779239.969519:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1877767642801920:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790779239.969560:0:18652:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 10cb4944-c4c7-43b5-9787-d954585b459c@192.168.203.3@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1790779239.969592:0:18652:0:(genops.c:1384:class_connect()) connect: client 10cb4944-c4c7-43b5-9787-d954585b459c, cookie 0xb1aa4014e936e1cf 00002000:00100000:3.0:1790779239.969603:0:18652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10cb4944-c4c7-43b5-9787-d954585b459c/ffff9b773c026800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790779239.969628:0:18652:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790779239.969732:0:18652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790779239.969762:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9b773c020000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779239.969807:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:2397:x1877767642801920:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 286us (4678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.969814:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1790779239.969836:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1790779239.969841:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1877767642802048:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790779239.969857:0:18652:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 10cb4944-c4c7-43b5-9787-d954585b459c@192.168.203.3@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1790779239.969873:0:18652:0:(genops.c:1384:class_connect()) connect: client 10cb4944-c4c7-43b5-9787-d954585b459c, cookie 0xb1aa4014e936e1d6 00002000:00100000:3.0:1790779239.969896:0:18652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10cb4944-c4c7-43b5-9787-d954585b459c/ffff9b773c021000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790779239.969903:0:18652:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790779239.969948:0:18652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790779239.969963:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9b773c022000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779239.969997:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:2397:x1877767642802048:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 144us (4794us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779239.970003:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00010000:00010000:2.0:1790779239.976759:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779240.234678:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779240.234761:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642802432 00000100:00100000:3.0:1790779240.234786:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642802432 00000100:00100000:3.0:1790779240.234845:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1790779240.234855:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+6:15040:x1877767642802432:12345-192.168.203.3@tcp:101:mkdir.0 00010000:00010000:3.0:1790779240.234876:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779240.234921:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936e1dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c49 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779240.235000:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779240.235023:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779240.235038:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779240.235081:0:17147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790779240.235085:0:17147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779240.235105:0:17147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779240.235129:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3200/0xb1aa4014e936e1dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c49 expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779240.235148:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c49 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779240.235156:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a99100) 00010000:00010000:3.0:1790779240.235160:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779240.235163:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3a00, rc 0) 00000100:00100000:3.0:1790779240.235386:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+7:15040:x1877767642802432:12345-192.168.203.3@tcp:101:mkdir.0 Request processed in 531us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779240.235395:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00010000:00010000:1.0:1790779241.001781:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779241.066692:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779241.066714:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663851008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779241.066780:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779241.066907:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663851008 00000100:00100000:1.0:1790779241.066914:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663851008 00000100:00100000:1.0:1790779241.066969:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790779241.066978:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663851008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779241.067016:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790779241.067069:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663851008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779241.067076:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1790779241.067170:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779241.067212:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663851008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790779242.024339:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779242.088276:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790779242.088299:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663851136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779242.088369:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779242.088762:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663851136 00000100:00100000:1.0:1790779242.088771:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663851136 00000100:00100000:1.0:1790779242.088946:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790779242.088956:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663851136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790779242.089094:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790779242.089175:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663851136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 220us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779242.089182:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790779242.089284:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663851136:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790779242.089775:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779242.601176:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779242.601211:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663851264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779242.601306:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779242.601395:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663851264 00000100:00100000:0.0:1790779242.601405:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663851264 00000100:00100000:0.0:1790779242.601460:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790779242.601470:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663851264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779242.601525:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790779242.601581:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663851264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779242.601589:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790779242.601645:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663851264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779242.602583:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779242.602602:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663851392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779242.602657:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779242.602910:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663851392 00000100:00100000:0.0:1790779242.602929:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663851392 00000100:00100000:0.0:1790779242.604205:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790779242.604237:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663851392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779242.604299:0:18106:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790779242.604397:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663851392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779242.604497:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663851392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779242.609819:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:1.0:1790779243.049850:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779243.113224:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779243.113245:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663851520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779243.113310:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779243.113356:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663851520 00000100:00100000:0.0:1790779243.113364:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663851520 00000100:00100000:0.0:1790779243.113425:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790779243.113436:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663851520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779243.113465:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779243.113512:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663851520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779243.113519:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790779243.113573:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1790779243.113595:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663851520:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790779243.114199:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779243.115597:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663851648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779243.116010:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779243.116070:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663851648 00000100:00100000:0.0:1790779243.116078:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663851648 00000100:00100000:0.0:1790779243.116123:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790779243.116141:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663851648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779243.116161:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779243.116207:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663851648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779243.116213:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790779243.116250:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663851648:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1790779243.117823:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1790779243.122490:0:18648:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10cb4944-c4c7-43b5-9787-d954585b459c 00000001:00100000:0.0:1790779243.122503:0:18648:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000001:00100000:2.0:1790779243.123030:0:17879:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 10cb4944-c4c7-43b5-9787-d954585b459c 00000001:00100000:2.0:1790779243.123037:0:17879:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000100:00100000:2.0:1790779243.123506:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663852032:0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.123787:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663851776:0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.123841:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1790779243.124001:0:17126:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10cb4944-c4c7-43b5-9787-d954585b459c 00000001:00100000:0.0:1790779243.124008:0:17126:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000100:00100000:0.0:1790779243.124024:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663852160:0@lo:400:kworker.0 00000100:00100000:0.0:1790779243.124056:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779243.124078:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663852672:0@lo:400:kworker.0 00000100:00100000:0.0:1790779243.124098:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779243.124142:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663852160 00000100:00100000:0.0:1790779243.124150:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663852160 00000100:00100000:0.0:1790779243.124187:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663852672 00000100:00100000:0.0:1790779243.124190:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663852672 00000100:00100000:0.0:1790779243.124214:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790779243.124222:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663852160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779243.124284:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663852160:12345-0@lo:400:kworker.0 Request processed in 62us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779243.124292:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790779243.124309:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790779243.124315:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663852672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779243.124340:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663852672:12345-0@lo:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779243.124346:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1790779243.124366:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779243.124378:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663851904:0@lo:400:kworker.0 00000100:00100000:0.0:1790779243.124405:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779243.124421:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663852416:0@lo:400:kworker.0 00000100:00100000:0.0:1790779243.124442:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779243.124457:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663852928:0@lo:400:kworker.0 00000100:00100000:0.0:1790779243.124478:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779243.124502:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663851904 00000100:00100000:0.0:1790779243.124506:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663851904 00000100:00100000:0.0:1790779243.124529:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790779243.124813:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779243.124832:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663852544:0@lo:400:kworker.0 00000100:00100000:2.0:1790779243.124853:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779243.124866:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663853056:0@lo:400:kworker.0 00000100:00100000:2.0:1790779243.124901:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779243.124986:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663852288:0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.125028:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779243.125047:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663852800:0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.125073:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663851776 00000100:00100000:3.0:1790779243.125077:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663851776 00000100:00100000:3.0:1790779243.125104:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790779243.125110:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3650:x1877767663851776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.125147:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3650:x1877767663851776:12345-0@lo:400:kworker.0 Request processed in 38us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779243.125153:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790779243.125870:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663852928 00000100:00100000:3.0:1790779243.125876:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663852928 00000100:00100000:3.0:1790779243.126069:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663852544 00000100:00100000:3.0:1790779243.126072:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663852544 00000100:00100000:3.0:1790779243.126091:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663853056 00000100:00100000:3.0:1790779243.126094:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663853056 00000100:00100000:3.0:1790779243.126107:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790779243.126113:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663852928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.126175:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663852928:12345-0@lo:400:kworker.0 Request processed in 61us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779243.126181:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790779243.126196:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790779243.126202:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663852544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.126233:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663852544:12345-0@lo:400:kworker.0 Request processed in 32us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779243.126240:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790779243.126251:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790779243.126257:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663853056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.126282:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663853056:12345-0@lo:400:kworker.0 Request processed in 26us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779243.126288:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790779243.126306:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663852416 00000100:00100000:3.0:1790779243.126309:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663852416 00000100:00100000:3.0:1790779243.126330:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663852032 00000100:00100000:3.0:1790779243.126332:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663852032 00000100:00100000:3.0:1790779243.126350:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779243.126355:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663852416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.126396:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663852416:12345-0@lo:400:kworker.0 Request processed in 40us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779243.126402:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779243.126412:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790779243.126424:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663852032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.126451:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663852032:12345-0@lo:400:kworker.0 Request processed in 28us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779243.126457:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790779243.126475:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663852288 00000100:00100000:3.0:1790779243.126479:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663852288 00000100:00100000:3.0:1790779243.126496:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790779243.126502:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663852288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779243.127209:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663851904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779243.127259:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663851904:12345-0@lo:400:kworker.0 Request processed in 2723us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779243.127267:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790779243.127332:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663852160:0@lo:400:kworker.0 00000100:00100000:0.0:1790779243.127345:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663852672:0@lo:400:kworker.0 00000100:00080000:2.0:1790779243.128571:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790779243.128578:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779243.128581:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779243.129097:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779243.129174:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663851776:0@lo:400:kworker.0 00000100:00100000:2.0:1790779243.129190:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663852288:0@lo:400:kworker.0 00000100:00100000:2.0:1790779243.129232:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663851904:0@lo:400:kworker.0 00000100:00100000:2.0:1790779243.129243:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663852416:0@lo:400:kworker.0 00000100:00100000:2.0:1790779243.129259:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663852928:0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.129452:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663852288:12345-0@lo:400:kworker.0 Request processed in 33us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779243.129466:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790779243.129502:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663852800 00000100:00100000:3.0:1790779243.129508:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663852800 00000100:00080000:2.0:1790779243.130001:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790779243.130242:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663852032:0@lo:400:kworker.0 00000100:00100000:0.0:1790779243.130255:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663852544:0@lo:400:kworker.0 00010000:00080000:0.0:1790779243.130272:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603bef800 x1877767663853056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779243.130283:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663853056:0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.130371:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790779243.130390:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663852800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779243.130470:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663852800:12345-0@lo:400:kworker.0 Request processed in 82us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779243.130476:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1790779243.131070:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603bedc00 x1877767663852800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779243.131094:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663852800:0@lo:400:kworker.0 00000001:02000400:1.0:1790779243.434178:0:20024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:3.0:1790779243.498514:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779244.075353:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779245.108307:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779245.239491:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779245.239532:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779245.239551:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779245.239569:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779245.239587:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779245.239594:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642802688 00000100:00100000:2.0:1790779245.239603:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642802688 00000100:00100000:3.0:1790779245.239605:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779245.239624:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642803072 00000100:00100000:3.0:1790779245.239627:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642803072 00000100:00100000:2.0:1790779245.239653:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642802816 00000100:00100000:2.0:1790779245.239656:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642802816 00000100:00100000:3.0:1790779245.239657:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642803584 00000100:00100000:3.0:1790779245.239659:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642803584 00000100:00100000:2.0:1790779245.239667:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642803328 00000100:00100000:2.0:1790779245.239669:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642803328 00000100:00100000:3.0:1790779245.239677:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:2.0:1790779245.239682:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:3.0:1790779245.239685:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642803072:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779245.239688:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2400:x1877767642802688:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779245.239754:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642803072:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779245.239761:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:3.0:1790779245.239779:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1790779245.239781:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1790779245.239785:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:2401:x1877767642803584:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779245.239789:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642802816:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779245.242056:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2400:x1877767642802688:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 2356us (2563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779245.242070:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:2.0:1790779245.242103:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:2.0:1790779245.242116:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cb4944-c4c7-43b5-9787-d954585b459c+5:2401:x1877767642803328:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779245.242208:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642802816:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 2418us (2655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779245.242217:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1790779245.242430:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:2401:x1877767642803584:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 2382us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779245.242442:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1790779245.242804:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779245.243590:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cb4944-c4c7-43b5-9787-d954585b459c+5:2401:x1877767642803328:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1475us (3998us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779245.243600:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:2.0:1790779245.243629:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642802560 00000100:00100000:2.0:1790779245.243638:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642802560 00000100:00100000:3.0:1790779245.243666:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642802944 00000100:00100000:3.0:1790779245.243670:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642802944 00000100:00100000:2.0:1790779245.243671:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 145 00000100:00100000:2.0:1790779245.243678:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2401:x1877767642802560:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779245.243700:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1790779245.243706:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642802944:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779245.243715:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2401:x1877767642802560:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 37us (4184us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779245.243728:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642802944:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779245.243731:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 145 00000100:00100000:3.0:1790779245.243734:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00080000:2.0:1790779245.243759:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790779245.243763:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779245.243766:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790779245.243768:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779245.247597:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779245.247635:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779245.247661:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642803456 00000100:00100000:1.0:1790779245.247669:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642803456 00000100:00100000:1.0:1790779245.247725:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1790779245.247735:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10cb4944-c4c7-43b5-9787-d954585b459c+5:2400:x1877767642803456:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779245.247804:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10cb4944-c4c7-43b5-9787-d954585b459c+5:2400:x1877767642803456:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779245.247811:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:0.0:1790779245.247863:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642803200 00000100:00100000:0.0:1790779245.247867:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642803200 00000100:00100000:0.0:1790779245.247943:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:0.0:1790779245.247950:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:2400:x1877767642803200:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779245.248004:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:2400:x1877767642803200:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 54us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779245.248012:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00080000:2.0:1790779245.248623:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779245.248629:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790779246.120543:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779246.184241:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663853184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779246.184354:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779246.185506:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663853184 00000100:00100000:0.0:1790779246.185521:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663853184 00000100:00100000:0.0:1790779246.185594:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790779246.185604:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663853184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779246.185644:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790779246.186269:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663853184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 663us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779246.186363:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1790779246.186404:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779246.187588:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663853184:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1790779246.192835:0:19466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10cb4944-c4c7-43b5-9787-d954585b459c 00010000:00010000:2.0:1790779247.144044:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790779247.191734:0:20171:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb3745fc0 20000000:00000080:0.0:1790779247.191756:0:20171:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b773af86000 uarg=0000000000000000 20000000:01000000:0.0:1790779247.191809:0:20171:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790779247.191817:0:20171:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790779247.191823:0:20171:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790779247.193858:0:20172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1790779247.201452:0:20171:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 00000100:00100000:1.0:1790779247.208487:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779247.208523:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663853312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779247.208647:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779247.208674:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663853312 00000100:00100000:0.0:1790779247.208686:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663853312 00000100:00080000:2.0:1790779247.208780:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779247.208805:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790779247.208819:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663853312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779247.208850:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790779247.208941:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663853312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779247.208950:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790779247.209006:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663853312:0@lo:13:osp-pre-0-1.0 10000000:01000000:3.0:1790779247.219439:0:20171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790779247.220094:0:20171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220123:0:20171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936de80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de79 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220132:0:20171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7701663800/0xb1aa4014e936de8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936de87 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220140:0:20171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b76039a2400/0xb1aa4014e936decd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936dec6 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220148:0:20171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e02b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e024 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220187:0:20171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e17b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba8 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220196:0:20171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e1ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c18 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220204:0:20171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220266:0:20171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e1ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c18 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220287:0:20171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e1ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c18 expref: 12 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779247.220307:0:20171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663853440:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779247.220443:0:20171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e17b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba8 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220452:0:20171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e17b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba8 expref: 12 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779247.220460:0:20171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663853568:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779247.220494:0:20171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e02b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e024 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220502:0:20171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e02b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e024 expref: 23 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779247.220526:0:20171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663853696:0@lo:104: 00000100:00100000:0.0:1790779247.220580:0:20171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790779247.220629:0:20171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b76039a2400/0xb1aa4014e936decd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936dec6 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220638:0:20171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b76039a2400/0xb1aa4014e936decd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936dec6 expref: 23 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779247.220647:0:20171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663853824:0@lo:104: 00000100:00100000:0.0:1790779247.220668:0:20171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779247.220709:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663853696 00000100:00100000:0.0:1790779247.220722:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663853696 00000100:00100000:0.0:1790779247.220775:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663853824 00000100:00100000:0.0:1790779247.220779:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663853824 00000100:00100000:0.0:1790779247.220796:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790779247.220805:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+4:20171:x1877767663853696:12345-0@lo:104: 00010000:00010000:0.0:1790779247.220821:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.220923:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790779247.220930:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+4:20171:x1877767663853696:12345-0@lo:104: Request processed in 126us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779247.220938:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790779247.220969:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790779247.220976:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+3:20171:x1877767663853824:12345-0@lo:104: 00010000:00010000:0.0:1790779247.220984:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.221045:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790779247.221051:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+3:20171:x1877767663853824:12345-0@lo:104: Request processed in 76us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779247.221058:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1790779247.221094:0:20171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7701663800/0xb1aa4014e936de8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936de87 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.221103:0:20171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7701663800/0xb1aa4014e936de8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936de87 expref: 23 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779247.221111:0:20171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663853952:0@lo:104: 00000100:00100000:0.0:1790779247.221135:0:20171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779247.221156:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663853952 00000100:00100000:0.0:1790779247.221160:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663853952 00000100:00100000:0.0:1790779247.221177:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790779247.221183:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+3:20171:x1877767663853952:12345-0@lo:104: 00010000:00010000:0.0:1790779247.221190:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.221218:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790779247.221223:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+3:20171:x1877767663853952:12345-0@lo:104: Request processed in 41us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779247.221229:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1790779247.221255:0:20171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936de80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936de79 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.221264:0:20171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936de80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936de79 expref: 23 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779247.221283:0:20171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663854080:0@lo:104: 00000100:00100000:0.0:1790779247.221307:0:20171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779247.221326:0:17130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663854080 00000100:00100000:0.0:1790779247.221330:0:17130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663854080 00000100:00100000:0.0:1790779247.221348:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790779247.221353:0:17130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+3:20171:x1877767663854080:12345-0@lo:104: 00010000:00010000:0.0:1790779247.221361:0:17130:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779247.221390:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790779247.221395:0:17130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+3:20171:x1877767663854080:12345-0@lo:104: Request processed in 42us (88us total) trans 0 rc 0/0 00010000:00010000:3.0:1790779247.221397:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1790779247.221401:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1790779247.221405:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779247.221419:0:20171:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603477840 going to sleep for 11 seconds 00010000:00010000:3.0:1790779247.221424:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663a00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779247.221429:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779247.221437:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779247.221444:0:20171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663853696:0@lo:104: 10000000:00010000:3.0:1790779247.221445:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779247.221452:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1790779247.221452:0:20171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663853824:0@lo:104: 00000100:00100000:0.0:1790779247.221458:0:20171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663853952:0@lo:104: 00000100:00100000:0.0:1790779247.221464:0:20171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663854080:0@lo:104: 00010000:00010000:3.0:1790779247.221487:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779247.221494:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779247.221520:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779247.221527:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7701663a00/0xb1aa4014e936e024 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e02b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779247.221544:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790779247.221547:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779247.221552:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769800 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779247.221630:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779247.221716:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779247.221722:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779247.221727:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790779247.221914:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779247.221921:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779247.222072:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1790779247.222319:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663854208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779247.222369:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779247.222403:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779247.222410:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663854336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779247.222432:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779247.222666:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663854208 00000100:00100000:2.0:1790779247.222674:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663854208 00010000:00010000:2.0:1790779247.222706:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e02b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e024 expref: 24 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779247.222739:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663854336 00000100:00100000:2.0:1790779247.222743:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663854336 00010000:00010000:2.0:1790779247.222755:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b76039a2400/0xb1aa4014e936decd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936dec6 expref: 25 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779247.222769:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790779247.222778:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+25:3651:x1877767663854208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779247.222795:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779247.222824:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e02b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e024 expref: 25 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.222835:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e02b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e024 expref: 25 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.222853:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e02b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e024 expref: 25 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.222871:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779247.222952:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3651:x1877767663854208:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779247.222968:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790779247.222988:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790779247.222994:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+23:3651:x1877767663854336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779247.223003:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779247.223007:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b76039a2400/0xb1aa4014e936decd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936dec6 expref: 23 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.223016:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b76039a2400/0xb1aa4014e936decd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936dec6 expref: 23 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.223027:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2400/0xb1aa4014e936decd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936dec6 expref: 23 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.223036:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779247.223059:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+22:3651:x1877767663854336:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779247.223066:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790779247.223108:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663854336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779247.223127:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663854208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779247.223446:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779247.223457:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936dec6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936decd expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.227408:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779247.227427:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.227441:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663e00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779247.227446:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.227458:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779247.227467:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779247.227474:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779247.227549:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.227558:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779247.227584:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.227593:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936de79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.227611:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779247.227613:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779247.227615:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779247.227625:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779247.227674:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663854464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779247.227768:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779247.227853:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663854464 00000100:00100000:2.0:1790779247.227863:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663854464 00010000:00010000:2.0:1790779247.227933:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936de80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de79 expref: 22 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779247.227981:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779247.227991:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+22:3650:x1877767663854464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779247.228008:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779247.228014:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936de80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de79 expref: 22 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.228025:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936de80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936de79 expref: 22 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.228045:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936de80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936de79 expref: 22 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.228061:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779247.228097:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3650:x1877767663854464:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779247.228105:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779247.228154:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663854464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779247.232253:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779247.232382:0:20171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663853440:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779247.232397:0:20171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20171:1877767663853568:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779247.232449:0:20171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779247.232553:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1790779247.232718:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779247.232722:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779247.232731:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779247.232772:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.232782:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779247.232787:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.232798:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779247.232807:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779247.232822:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779247.232917:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.232924:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779247.232949:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.232956:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936de87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936de8e expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.232988:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779247.232990:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779247.232992:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779247.233022:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663854592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779247.233080:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779247.237715:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642803712 00000100:00100000:1.0:1790779247.237736:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642803712 00010000:00010000:1.0:1790779247.237792:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e1ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c18 expref: 13 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779247.237902:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642803840 00000100:00100000:1.0:1790779247.237907:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642803840 00010000:00010000:1.0:1790779247.237926:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e17b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba8 expref: 14 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779247.237973:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663854592 00000100:00100000:1.0:1790779247.237977:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663854592 00010000:00010000:1.0:1790779247.237992:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7701663800/0xb1aa4014e936de8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de87 expref: 21 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779247.238008:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:1.0:1790779247.238016:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+14:2401:x1877767642803712:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779247.238034:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779247.238040:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e1ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c18 expref: 14 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238054:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e1ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c18 expref: 14 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238077:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e1ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c18 expref: 14 pid: 17140 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238095:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779247.238171:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2401:x1877767642803712:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 154us (5934us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779247.238179:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:1.0:1790779247.238205:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:1.0:1790779247.238212:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603aad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:2400:x1877767642803840:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779247.238220:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779247.238224:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e17b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba8 expref: 12 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238246:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e17b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba8 expref: 12 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238257:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e17b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba8 expref: 12 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238267:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779247.238287:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603aad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:2400:x1877767642803840:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 76us (5735us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779247.238294:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:1.0:1790779247.238343:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790779247.238350:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3650:x1877767663854592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779247.238359:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779247.238364:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7701663800/0xb1aa4014e936de8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936de87 expref: 21 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238372:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7701663800/0xb1aa4014e936de8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936de87 expref: 21 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238384:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701663800/0xb1aa4014e936de8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936de87 expref: 21 pid: 17141 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238399:0:17133:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238408:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238425:0:17133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238439:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238446:0:17133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238453:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238460:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779247.238465:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238475:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238491:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779247.238504:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779247.238561:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f89954ec-b1b4-4b66-a198-81b81a38f825+20:3650:x1877767663854592:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (5480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779247.238568:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790779247.238616:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663854592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779247.238856:0:20171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.238866:0:20171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779247.238873:0:20171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e1eb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779247.720584:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663854720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779247.720694:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779247.721094:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663854720 00000100:00100000:1.0:1790779247.721105:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663854720 00000100:00100000:1.0:1790779247.721177:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790779247.721188:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663854720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779247.721255:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790779247.721430:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663854720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 243us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779247.721439:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790779247.721558:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663854720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779247.721866:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779247.721895:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663854848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779247.721965:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779247.722154:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663854848 00000100:00100000:3.0:1790779247.722161:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663854848 00000100:00100000:3.0:1790779247.722207:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790779247.722217:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663854848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779247.722246:0:18106:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790779247.722304:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663854848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779247.722312:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790779247.722488:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663854848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790779248.169383:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779248.238327:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663854976:0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.238378:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663855232:0@lo:400:kworker.0 00000100:00100000:1.0:1790779248.238633:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663855104:0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.243644:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779248.243728:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663855744:0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.243781:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779248.243805:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663856256:0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.243834:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779248.243870:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663856768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779248.243916:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779248.243966:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790779248.243974:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663855360:0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.243996:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779248.244017:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663855872:0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.244046:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779248.244356:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663856384:0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.244383:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779248.244469:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663855232 00000100:00100000:0.0:1790779248.244479:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663855232 00000100:00100000:0.0:1790779248.244540:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663855744 00000100:00100000:0.0:1790779248.244544:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663855744 00000100:00100000:0.0:1790779248.244556:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663855360 00000100:00100000:0.0:1790779248.244558:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663855360 00000100:00100000:0.0:1790779248.244570:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663855872 00000100:00100000:0.0:1790779248.244572:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663855872 00000100:00100000:0.0:1790779248.244588:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790779248.244596:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663855232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.244665:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663855232:12345-0@lo:400:kworker.0 Request processed in 69us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779248.244689:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790779248.244706:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790779248.244711:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663855744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.244738:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663855744:12345-0@lo:400:kworker.0 Request processed in 27us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779248.244744:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790779248.244753:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790779248.244757:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663855360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.244781:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663855360:12345-0@lo:400:kworker.0 Request processed in 24us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779248.244787:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790779248.244796:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790779248.244801:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7705ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663855872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.244828:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7705ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663855872:12345-0@lo:400:kworker.0 Request processed in 27us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779248.244833:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790779248.245162:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663856256 00000100:00100000:0.0:1790779248.245167:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663856256 00000100:00100000:0.0:1790779248.245198:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663856384 00000100:00100000:0.0:1790779248.245201:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663856384 00000100:00100000:0.0:1790779248.245219:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790779248.245226:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663856256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.245261:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663856256:12345-0@lo:400:kworker.0 Request processed in 36us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779248.245267:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790779248.245285:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790779248.245291:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663856384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.245318:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663856384:12345-0@lo:400:kworker.0 Request processed in 28us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779248.245324:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790779248.245341:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663856768 00000100:00100000:0.0:1790779248.245345:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663856768 00000100:00100000:0.0:1790779248.245367:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790779248.245372:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663856768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779248.245396:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779248.245551:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663856768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779248.245558:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1790779248.245588:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779248.245594:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790779248.245596:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790779248.245598:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779248.245647:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663855360:0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.245661:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663855872:0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.245671:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663856384:0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.245686:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663856768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779248.245698:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663855232:0@lo:400:kworker.0 00000100:00100000:0.0:1790779248.245709:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663855744:0@lo:400:kworker.0 00010000:00080000:0.0:1790779248.245723:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7f6a00 x1877767663856256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779248.245741:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663856256:0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.247787:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779248.247859:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663855488:0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.247947:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779248.247997:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663856000:0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.248023:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779248.248043:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663856512:0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.248066:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779248.248104:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663854976 00000100:00100000:2.0:1790779248.248113:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663854976 00000100:00100000:2.0:1790779248.248164:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790779248.248191:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+20:3649:x1877767663854976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.248683:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+20:3649:x1877767663854976:12345-0@lo:400:kworker.0 Request processed in 492us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779248.248691:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790779248.248752:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663854976:0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.248779:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663855488 00000100:00100000:2.0:1790779248.248783:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663855488 00000100:00100000:2.0:1790779248.248811:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663856000 00000100:00100000:2.0:1790779248.248814:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663856000 00000100:00100000:2.0:1790779248.248825:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663856512 00000100:00100000:2.0:1790779248.248827:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663856512 00000100:00100000:2.0:1790779248.248869:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790779248.248875:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663855488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.248988:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663855488:12345-0@lo:400:kworker.0 Request processed in 113us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779248.248995:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790779248.249009:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790779248.249015:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663856000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.249044:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663856000:12345-0@lo:400:kworker.0 Request processed in 30us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779248.249050:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790779248.249063:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790779248.249068:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663856512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.249096:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663856512:12345-0@lo:400:kworker.0 Request processed in 29us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779248.249102:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790779248.249146:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663856000:0@lo:400:kworker.0 00010000:00080000:2.0:1790779248.249159:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7f6300 x1877767663856512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779248.249169:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663856512:0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.249179:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663855488:0@lo:400:kworker.0 00000100:00080000:2.0:1790779248.249235:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779248.251281:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779248.251350:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663855616:0@lo:400:kworker.0 00000100:00100000:1.0:1790779248.251384:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779248.251417:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663856128:0@lo:400:kworker.0 00000100:00100000:1.0:1790779248.251445:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779248.251467:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663856640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779248.251504:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779248.251568:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663855104 00000100:00100000:1.0:1790779248.251576:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663855104 00000100:00100000:1.0:1790779248.251632:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663855616 00000100:00100000:1.0:1790779248.251635:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663855616 00000100:00100000:1.0:1790779248.251653:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790779248.251661:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663855104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.251670:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790779248.251679:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663855616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779248.252357:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663855616:12345-0@lo:400:kworker.0 Request processed in 676us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779248.252366:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790779248.252438:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663855104:12345-0@lo:400:kworker.0 Request processed in 776us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779248.252445:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790779248.252508:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663855104:0@lo:400:kworker.0 00000100:00100000:1.0:1790779248.252521:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663855616:0@lo:400:kworker.0 00000100:00100000:1.0:1790779248.252556:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663856128 00000100:00100000:1.0:1790779248.252561:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663856128 00000100:00100000:1.0:1790779248.252628:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790779248.252636:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663856128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779248.252689:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663856128:12345-0@lo:400:kworker.0 Request processed in 54us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779248.252696:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790779248.252723:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663856128:0@lo:400:kworker.0 00000100:00100000:1.0:1790779248.252748:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663856640 00000100:00100000:1.0:1790779248.252752:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663856640 00000100:00100000:1.0:1790779248.252784:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790779248.252791:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663856640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790779248.252809:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790779248.252847:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663856640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779248.252853:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790779248.252899:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663856640:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1790779248.253348:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1790779248.810246:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790779248.948745:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779248.948791:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642803968 00000100:00100000:3.0:1790779248.948810:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642803968 00000100:00100000:3.0:1790779248.948871:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:3.0:1790779248.948897:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:14887:x1877767642803968:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779248.949742:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779248.949774:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936e1f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c50 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779248.949813:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936e1f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c50 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779248.949825:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936e1f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c50 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779248.949836:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3200, rc 0) 00000100:00100000:3.0:1790779248.950102:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:14887:x1877767642803968:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 1220us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779248.950111:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:0.0:1790779248.972050:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779248.972633:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642804096 00000100:00100000:3.0:1790779248.972649:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642804096 00000100:00100000:3.0:1790779248.972723:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:3.0:1790779248.972733:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:14887:x1877767642804096:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779248.972964:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:14887:x1877767642804096:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 231us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779248.972973:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:0.0:1790779248.979026:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779248.979123:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642804224 00000100:00100000:1.0:1790779248.979138:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642804224 00000100:00100000:1.0:1790779248.979209:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:1.0:1790779248.979221:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:14887:x1877767642804224:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779248.979426:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:14887:x1877767642804224:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 205us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779248.979435:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:0.0:1790779248.996341:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779248.996381:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642804352 00000100:00100000:0.0:1790779248.996394:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642804352 00000100:00100000:0.0:1790779249.000192:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:0.0:1790779249.000229:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:14887:x1877767642804352:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779249.000257:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779249.000285:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768800/0xb1aa4014e936e1f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c57 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.000326:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768800/0xb1aa4014e936e1f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c57 expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.000338:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768800/0xb1aa4014e936e1f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c57 expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.000349:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768800, rc 0) 00000100:00100000:0.0:1790779249.000462:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:14887:x1877767642804352:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 254us (4134us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779249.000472:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:3.0:1790779249.003911:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779249.005256:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642804480 00000100:00100000:0.0:1790779249.005275:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642804480 00000100:00100000:0.0:1790779249.005348:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:0.0:1790779249.005359:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:14887:x1877767642804480:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779249.007741:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:14887:x1877767642804480:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 2358us (3841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779249.007757:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:2.0:1790779249.011761:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779249.012291:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642804608 00000100:00100000:1.0:1790779249.012306:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642804608 00000100:00100000:1.0:1790779249.012378:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:1.0:1790779249.012397:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:14887:x1877767642804608:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779249.014384:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:14887:x1877767642804608:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 1974us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779249.014399:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 152 00010000:00010000:3.0:1790779249.193862:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790779249.257027:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790779249.257078:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b773424c000 from 13 10000000:01000000:3.0:1790779249.257087:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790779249.257392:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779249.257407:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779249.257420:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779249.257454:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663856896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790779249.257554:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779249.257613:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663856896 00000100:00100000:3.0:1790779249.257616:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b774123a240 going to sleep for 11 seconds 00000100:00100000:0.0:1790779249.257624:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663856896 00000100:00100000:0.0:1790779249.257689:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790779249.257701:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760447ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+20:17143:x1877767663856896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779249.257719:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779249.257735:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769000/0xb1aa4014e936e207 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e200 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.257765:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769000/0xb1aa4014e936e207 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e200 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.257778:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769000/0xb1aa4014e936e207 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e200 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.257788:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769000, rc 0) 00000100:00100000:0.0:1790779249.257848:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760447ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+21:17143:x1877767663856896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779249.257857:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790779249.258023:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663856896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779249.258227:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779249.258239:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779249.258318:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779249.258932:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779249.258974:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b774123a240 going to sleep for 11 seconds 00000100:00100000:1.0:1790779249.259348:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663857024 00000100:00100000:1.0:1790779249.259356:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663857024 00000100:00100000:1.0:1790779249.259411:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790779249.259422:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:17143:x1877767663857024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779249.259599:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:17143:x1877767663857024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779249.259607:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790779249.260662:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779249.260734:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779249.260817:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779249.260874:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779249.260985:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663857152 00000100:00100000:3.0:1790779249.260993:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663857152 00000100:00100000:3.0:1790779249.261046:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790779249.261057:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+21:17143:x1877767663857152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779249.261189:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+21:17143:x1877767663857152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779249.261204:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790779249.261298:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790779249.262266:0:20242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790779249.264109:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790779249.264156:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779249.264171:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.264188:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779249.264248:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790779249.264253:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b77340a4000 from 13 10000000:01000000:1.0:1790779249.264257:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779249.264315:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779249.264326:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779249.264340:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779249.264372:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779249.264459:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779249.264512:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702abbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790779249.265374:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663857280 00000100:00100000:3.0:1790779249.265388:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663857280 00000100:00100000:3.0:1790779249.265456:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790779249.265467:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+21:17143:x1877767663857280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779249.265486:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779249.265508:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e215 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e20e expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779249.265543:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e20e expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779249.265555:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e20e expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779249.265564:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2800, rc 0) 00000100:00100000:3.0:1790779249.265655:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+22:17143:x1877767663857280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779249.265663:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790779249.265806:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779249.265845:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779249.265856:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779249.265998:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779249.266031:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779249.266073:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702abbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779249.266245:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663857408 00000100:00100000:2.0:1790779249.266251:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663857408 00000100:00100000:2.0:1790779249.266285:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790779249.266294:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+22:17143:x1877767663857408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779249.266429:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+22:17143:x1877767663857408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779249.266451:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790779249.267033:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779249.267076:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779249.267140:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779249.267165:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702abbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790779249.267293:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663857536 00000100:00100000:3.0:1790779249.267299:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663857536 00000100:00100000:3.0:1790779249.267338:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790779249.267346:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+22:17143:x1877767663857536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779249.267448:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+22:17143:x1877767663857536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779249.267456:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790779249.267626:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790779249.269696:0:20243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790779249.270096:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790779249.270128:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779249.270143:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779249.270158:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779249.270173:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790779249.270176:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7703509000 from 13 10000000:01000000:1.0:1790779249.270180:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779249.270229:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779249.270260:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779249.270274:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779249.270308:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779249.270398:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779249.270461:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702abbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779249.270622:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663857664 00000100:00100000:0.0:1790779249.270632:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663857664 00000100:00100000:0.0:1790779249.270698:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790779249.270709:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+22:17143:x1877767663857664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779249.270728:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779249.270745:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e223 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e21c expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.270777:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e21c expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.270789:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e21c expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.270800:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768c00, rc 0) 00000100:00100000:0.0:1790779249.270863:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+23:17143:x1877767663857664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779249.270872:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790779249.274251:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779249.274298:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779249.274314:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779249.274451:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779249.274537:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779249.274596:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702abbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779249.274722:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663857792 00000100:00100000:2.0:1790779249.274730:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663857792 00000100:00100000:2.0:1790779249.274789:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790779249.274800:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:17143:x1877767663857792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779249.275006:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:17143:x1877767663857792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779249.275036:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790779249.275351:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779249.275389:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779249.275448:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779249.275477:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702abbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779249.275582:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663857920 00000100:00100000:0.0:1790779249.275588:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663857920 00000100:00100000:0.0:1790779249.275639:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790779249.275646:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+23:17143:x1877767663857920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779249.275758:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+23:17143:x1877767663857920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779249.275766:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790779249.276164:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76044ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663857920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790779249.277238:0:20244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790779249.280800:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790779249.280854:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779249.280870:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.280899:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779249.280915:0:17143:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790779249.280919:0:17143:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7604541000 from 13 10000000:01000000:0.0:1790779249.280922:0:17143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790779249.280995:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.281004:0:17143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.281020:0:17143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779249.281058:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663858048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779249.281152:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779249.281227:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779249.281237:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663858048 00000100:00100000:3.0:1790779249.281249:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663858048 00000100:00100000:3.0:1790779249.281313:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790779249.281325:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:17143:x1877767663858048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779249.281342:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779249.281356:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e231 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e22a expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779249.281383:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e22a expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779249.281394:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e22a expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779249.281402:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3600, rc 0) 00000100:00100000:3.0:1790779249.281451:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+24:17143:x1877767663858048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779249.281458:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790779249.281630:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663858048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779249.281664:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779249.281673:0:17143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779249.281740:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663858176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779249.281770:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779249.281794:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779249.281928:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663858176 00000100:00100000:3.0:1790779249.281933:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663858176 00000100:00100000:3.0:1790779249.281974:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790779249.281981:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+24:17143:x1877767663858176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779249.282134:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+24:17143:x1877767663858176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779249.282141:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790779249.282979:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663858176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779249.283043:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663858304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779249.283119:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779249.283166:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779249.283211:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663858304 00000100:00100000:3.0:1790779249.283217:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663858304 00000100:00100000:3.0:1790779249.283269:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790779249.283279:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:17143:x1877767663858304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779249.283394:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:17143:x1877767663858304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779249.283402:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790779249.283683:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f89954ec-b1b4-4b66-a198-81b81a38f825:17143:1877767663858304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790779249.286652:0:20245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790779249.286939:0:17143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790779249.286980:0:17143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790779249.286997:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779249.287011:0:17143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779250.216642:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779250.355467:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779250.355587:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779250.355616:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779250.355677:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642805120 00000100:00100000:3.0:1790779250.355689:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642805120 00000100:00100000:3.0:1790779250.355785:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1790779250.355796:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642805120:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779250.355985:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642805120:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 190us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779250.355994:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00080000:1.0:1790779250.358687:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779250.363265:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779250.363315:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779250.363342:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779250.364590:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642805632 00000100:00100000:1.0:1790779250.364608:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642805632 00000100:00100000:1.0:1790779250.364711:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:1.0:1790779250.364723:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10cb4944-c4c7-43b5-9787-d954585b459c+5:2401:x1877767642805632:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779250.364833:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10cb4944-c4c7-43b5-9787-d954585b459c+5:2401:x1877767642805632:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 111us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779250.364842:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00080000:1.0:1790779250.364874:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779250.364952:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642804736 00000100:00100000:1.0:1790779250.364957:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642804736 00000100:00100000:1.0:1790779250.364988:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 165 00000100:00100000:1.0:1790779250.364994:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2401:x1877767642804736:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779250.365021:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2401:x1877767642804736:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779250.365027:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 165 00000100:00100000:0.0:1790779250.369646:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642804864 00000100:00100000:0.0:1790779250.369668:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642804864 00000100:00100000:3.0:1790779250.370632:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642805376 00000100:00100000:3.0:1790779250.370645:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642805376 00000100:00100000:3.0:1790779250.370709:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:3.0:1790779250.370723:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2401:x1877767642804864:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779250.370836:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2401:x1877767642804864:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 116us (15382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779250.370844:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:1.0:1790779250.371121:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00080000:0.0:1790779250.372311:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779250.372434:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:2401:x1877767642805376:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779250.372527:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:2401:x1877767642805376:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1397us (16909us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779250.372538:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:2.0:1790779250.375771:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779250.375820:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779250.375853:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779250.375917:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642804992 00000100:00100000:2.0:1790779250.375931:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642804992 00000100:00100000:2.0:1790779250.376007:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642805504 00000100:00100000:2.0:1790779250.376010:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642805504 00000100:00100000:2.0:1790779250.376039:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:2.0:1790779250.376051:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642804992:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779250.376283:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642804992:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 234us (12939us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779250.376293:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:2.0:1790779250.376335:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:2.0:1790779250.376342:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+5:2401:x1877767642805504:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779250.376441:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+5:2401:x1877767642805504:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 99us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779250.376448:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00080000:2.0:1790779250.376470:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779250.378171:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642805248 00000100:00100000:1.0:1790779250.378189:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642805248 00000100:00100000:1.0:1790779250.378278:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642805760 00000100:00100000:1.0:1790779250.378282:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642805760 00000100:00100000:1.0:1790779250.378325:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:1.0:1790779250.378337:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642805248:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779250.378457:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642805248:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 121us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779250.378466:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:1.0:1790779250.378486:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1790779250.378493:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10cb4944-c4c7-43b5-9787-d954585b459c+5:2401:x1877767642805760:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779250.378517:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10cb4944-c4c7-43b5-9787-d954585b459c+5:2401:x1877767642805760:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (2663us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779250.378523:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00080000:2.0:1790779250.378791:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790779251.242864:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779251.304666:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663858432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779251.304779:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779251.305014:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663858432 00000100:00100000:0.0:1790779251.305025:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663858432 00000100:00100000:0.0:1790779251.305117:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790779251.305128:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663858432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779251.305168:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790779251.305246:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663858432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779251.305254:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790779251.305327:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663858432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790779251.305725:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779251.524974:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779251.525510:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642805888 00000100:00100000:2.0:1790779251.525523:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642805888 00000100:00100000:2.0:1790779251.525608:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1790779251.525620:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:15556:x1877767642805888:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779251.525651:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779251.525679:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670a00/0xb1aa4014e936e238 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c5e expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.525770:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e23f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.525787:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e23f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.525800:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e23f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.525817:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e246 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.525843:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.525850:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526112:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670e00/0xb1aa4014e936e24d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526122:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670e00/0xb1aa4014e936e24d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526130:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670e00/0xb1aa4014e936e24d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779251.526162:0:17146:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790779251.526166:0:17146:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779251.526292:0:17146:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670e00/0xb1aa4014e936e24d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526305:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e23f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526313:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e23f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526320:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e23f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526327:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779251.526332:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e23f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526349:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e23f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526362:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a99100) 00010000:00010000:2.0:1790779251.526365:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779251.526372:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e23f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526378:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e23f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526396:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526402:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e246 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526408:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526414:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602670600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779251.526417:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526424:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e246 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526432:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b7712a97400) 00010000:00010000:2.0:1790779251.526434:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779251.526438:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e246 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526455:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e246 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526498:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670a00/0xb1aa4014e936e238 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c5e expref: 8 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526511:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670e00/0xb1aa4014e936e24d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c5e expref: 7 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.526519:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b7712a97a00) 00010000:00010000:2.0:1790779251.526522:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779251.526524:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602670e00, rc 0) 00000100:00100000:2.0:1790779251.526754:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:15556:x1877767642805888:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1135us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779251.526762:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:1.0:1790779251.539015:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779251.539139:0:17158:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642806016 00000100:00100000:2.0:1790779251.539152:0:17158:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642806016 00000100:00100000:2.0:1790779251.539236:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:2.0:1790779251.539248:0:17158:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:15556:x1877767642806016:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790779251.539366:0:17158:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:15556:x1877767642806016:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 Request processed in 120us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779251.539375:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1790779251.542461:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779251.542668:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642806272 00000100:00100000:0.0:1790779251.542682:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642806272 00000100:00100000:0.0:1790779251.542758:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1790779251.542770:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:15556:x1877767642806272:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779251.542798:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779251.542827:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e254 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c65 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.542972:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e25b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.542990:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e25b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543005:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e25b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543022:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e262 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543030:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e262 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543037:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e262 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543166:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae200/0xb1aa4014e936e269 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543175:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae200/0xb1aa4014e936e269 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543531:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae200/0xb1aa4014e936e269 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779251.543545:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790779251.543745:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e25b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543754:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e25b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543761:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e25b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543767:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779251.543773:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e25b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543781:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e25b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543796:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b7712a97a00) 00010000:00010000:0.0:1790779251.543799:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779251.543804:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e25b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543810:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e25b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543826:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e262 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543832:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e262 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543845:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e262 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543850:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034afc00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779251.543853:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e262 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543860:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e262 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543867:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b7603616500) 00010000:00010000:0.0:1790779251.543870:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779251.543873:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e262 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.543952:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e262 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.545140:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e254 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c65 expref: 10 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.545167:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae200/0xb1aa4014e936e269 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c65 expref: 9 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.545176:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603616a00) 00010000:00010000:0.0:1790779251.545307:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779251.545313:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034ae200, rc 0) 00000100:00100000:0.0:1790779251.545459:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:15556:x1877767642806272:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 2689us (3011us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790779251.545484:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1790779251.552155:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779251.553405:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642806400 00000100:00100000:3.0:1790779251.553564:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642806400 00000100:00100000:3.0:1790779251.553646:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1790779251.553657:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:15556:x1877767642806400:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790779251.554071:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:15556:x1877767642806400:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 414us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779251.554081:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:1.0:1790779251.569992:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779251.570089:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642806528 00000100:00100000:3.0:1790779251.570104:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642806528 00000100:00100000:3.0:1790779251.570167:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:3.0:1790779251.570191:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:15556:x1877767642806528:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1790779251.571332:0:17147:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1081us 00000100:00100000:3.0:1790779251.618044:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:15556:x1877767642806528:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 47855us (48055us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779251.618060:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:0.0:1790779251.640093:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779251.640336:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642806656 00000100:00100000:2.0:1790779251.640349:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642806656 00000100:00100000:2.0:1790779251.640427:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:2.0:1790779251.640439:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:15562:x1877767642806656:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779251.640488:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779251.640517:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670a00/0xb1aa4014e936e277 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c6c expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640599:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e27e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640617:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e27e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640631:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e27e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640648:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e285 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640655:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640662:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640713:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e27e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640721:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e27e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640728:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e27e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640734:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602670600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779251.640747:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e27e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640756:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e27e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640769:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a99100) 00010000:00010000:2.0:1790779251.640773:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779251.640779:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e27e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640786:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670600/0xb1aa4014e936e27e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640801:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640808:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e285 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640814:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e285 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640820:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779251.640823:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e285 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640829:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e285 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640836:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b7712a97400) 00010000:00010000:2.0:1790779251.640838:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779251.640848:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e285 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.640855:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e285 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.641395:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670a00/0xb1aa4014e936e277 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c6c expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.641411:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a99100) 00010000:00010000:2.0:1790779251.641413:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779251.641417:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670a00/0xb1aa4014e936e277 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c6c expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.641429:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602670a00, rc 0) 00000100:00100000:0.0:1790779251.641678:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:15562:x1877767642806656:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1238us (1598us total) trans 0 rc 301/301 00000100:00100000:0.0:1790779251.641687:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1790779251.651712:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779251.651852:0:17155:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642806784 00000100:00100000:2.0:1790779251.651864:0:17155:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642806784 00000100:00100000:2.0:1790779251.652000:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:2.0:1790779251.652013:0:17155:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:15562:x1877767642806784:12345-192.168.203.3@tcp:700:lfs.0 00000100:00100000:2.0:1790779251.652135:0:17155:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:15562:x1877767642806784:12345-192.168.203.3@tcp:700:lfs.0 Request processed in 117us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779251.652145:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:1.0:1790779251.654103:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779251.654503:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642807040 00000100:00100000:0.0:1790779251.654525:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642807040 00000100:00100000:0.0:1790779251.654606:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:0.0:1790779251.654618:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:15562:x1877767642807040:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:0.0:1790779251.654699:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779251.654732:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670000/0xb1aa4014e936e1a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425bd9 expref: 9 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.654754:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a99100) 00010000:00010000:0.0:1790779251.654759:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790779251.654835:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.654851:0:17148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c49 expref: 5 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.654861:0:17148:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.655298:0:17148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c49 expref: 5 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.655338:0:17148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c49 expref: 5 pid: 17147 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779251.655356:0:17148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17148:1877767663858560:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779251.655474:0:17148:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707546a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779251.662726:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779251.662915:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642807168 00000100:00100000:1.0:1790779251.662935:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642807168 00010000:00010000:1.0:1790779251.662990:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c49 expref: 6 pid: 17147 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779251.663038:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:1.0:1790779251.663049:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10cb4944-c4c7-43b5-9787-d954585b459c+6:2401:x1877767642807168:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779251.663067:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779251.663076:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c49 expref: 6 pid: 17147 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779251.663091:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c49 expref: 6 pid: 17147 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779251.663137:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a99100) 00010000:00010000:1.0:1790779251.663143:0:17133:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779251.663154:0:17133:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779251.663162:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779251.663185:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779251.663250:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10cb4944-c4c7-43b5-9787-d954585b459c+6:2401:x1877767642807168:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 203us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779251.663259:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00010000:00010000:2.0:1790779251.665769:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e1e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c49 expref: 5 pid: 17147 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779251.665804:0:17148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17148:1877767663858560:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779251.665837:0:17148:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.666040:0:17148:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.666049:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.666083:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.666097:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779251.666108:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670211:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670241:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670256:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779251.670276:0:17148:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a53657de reply state 00000000b684523b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670290:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670298:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:3.0:1790779251.670302:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790779251.670307:0:17148:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790779251.670315:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790779251.670324:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670332:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670352:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670358:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034afc00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779251.670364:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670373:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670386:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7712a99100) 00010000:00010000:3.0:1790779251.670389:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779251.670393:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670399:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afc00/0xb1aa4014e936e28c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779251.670421:0:17148:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a53657de reply state 00000000b684523b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670431:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.670436:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b7712a97400) 00010000:00010000:3.0:1790779251.670439:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790779251.670441:0:17148:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1790779251.670821:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+10:15562:x1877767642807040:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 16199us (16722us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790779251.670832:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000040:00080000:1.0:1790779251.688635:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790779251.813455:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779251.813600:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642807296 00000100:00100000:3.0:1790779251.813615:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642807296 00000100:00100000:3.0:1790779251.813705:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:3.0:1790779251.813717:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+10:15570:x1877767642807296:12345-192.168.203.3@tcp:101:lctl.0 00010000:00010000:3.0:1790779251.813761:0:19938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779251.813793:0:19938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663e00/0xb1aa4014e936e2a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c73 expref: -99 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.813953:0:19938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936e2a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.813970:0:19938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936e2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.813985:0:19938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936e2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779251.814043:0:19938:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790779251.814048:0:19938:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779251.814097:0:19938:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936e2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.814126:0:19938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663e00/0xb1aa4014e936e2a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c73 expref: 12 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.814150:0:19938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936e2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c73 expref: 11 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.814159:0:19938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7707e69900) 00010000:00010000:3.0:1790779251.814162:0:19938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779251.814184:0:19938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663a00, rc 0) 00000100:00100000:3.0:1790779251.814256:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+11:15570:x1877767642807296:12345-192.168.203.3@tcp:101:lctl.0 Request processed in 542us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779251.814263:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000040:00080000:2.0:1790779251.883122:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790779251.886539:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779251.886798:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642807424 00000100:00100000:3.0:1790779251.886812:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642807424 00000100:00100000:3.0:1790779251.886910:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1790779251.886922:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+5:15571:x1877767642807424:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779251.886965:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779251.886993:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663e00/0xb1aa4014e936e2af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c7a expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.887088:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e2b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.887107:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.887120:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779251.887176:0:17147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790779251.887181:0:17147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779251.887206:0:17147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.887234:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663e00/0xb1aa4014e936e2af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c7a expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.887272:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c7a expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.887301:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7707e69900) 00010000:00010000:3.0:1790779251.887304:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779251.887308:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3a00, rc 0) 00000100:00100000:3.0:1790779251.887395:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+6:15571:x1877767642807424:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 475us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779251.887403:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:1.0:1790779251.891285:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779251.891564:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642807552 00000100:00100000:3.0:1790779251.891586:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642807552 00000100:00100000:3.0:1790779251.891663:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:3.0:1790779251.891674:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cb4944-c4c7-43b5-9787-d954585b459c+6:15571:x1877767642807552:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779251.891702:0:19938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779251.891729:0:19938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936e2bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c81 expref: -99 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.891819:0:19938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e2c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.891838:0:19938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.891851:0:19938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.891864:0:19938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.891871:0:19938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892009:0:19938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892110:0:19938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936e2d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892119:0:19938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936e2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892125:0:19938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936e2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779251.892173:0:19938:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790779251.892177:0:19938:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779251.892199:0:19938:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936e2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892214:0:19938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892222:0:19938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e2c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892230:0:19938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e2c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892235:0:19938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779251.892241:0:19938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e2c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892251:0:19938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e2c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892271:0:19938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7707e69900) 00010000:00010000:3.0:1790779251.892275:0:19938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779251.892281:0:19938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e2c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892288:0:19938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e2c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892305:0:19938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892312:0:19938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892318:0:19938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892323:0:19938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ae00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779251.892327:0:19938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892333:0:19938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892341:0:19938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b7712a97400) 00010000:00010000:3.0:1790779251.892343:0:19938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779251.892346:0:19938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892352:0:19938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892395:0:19938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936e2bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c81 expref: 8 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892411:0:19938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936e2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c81 expref: 7 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.892418:0:19938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:3.0:1790779251.892421:0:19938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779251.892423:0:19938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894a400, rc 0) 00000100:00100000:3.0:1790779251.895291:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cb4944-c4c7-43b5-9787-d954585b459c+7:15571:x1877767642807552:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 3192us (3595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779251.895309:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0:1790779251.899843:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779251.900074:0:17158:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642807680 00000100:00100000:2.0:1790779251.900087:0:17158:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642807680 00000100:00100000:2.0:1790779251.900160:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1790779251.900172:0:17158:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10cb4944-c4c7-43b5-9787-d954585b459c+5:15571:x1877767642807680:12345-192.168.203.3@tcp:900:lfs.0 00000100:00100000:2.0:1790779251.900296:0:17158:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10cb4944-c4c7-43b5-9787-d954585b459c+5:15571:x1877767642807680:12345-192.168.203.3@tcp:900:lfs.0 Request processed in 126us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779251.900305:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1790779251.910633:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779251.911031:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642807936 00000100:00100000:3.0:1790779251.911045:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642807936 00000100:00100000:3.0:1790779251.911185:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:3.0:1790779251.911197:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+7:15571:x1877767642807936:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779251.911226:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779251.911254:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c88 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779251.911408:0:17147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790779251.911544:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c88 expref: 9 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.911562:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7707e69900) 00010000:00010000:3.0:1790779251.911566:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790779251.911592:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e2d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c88 expref: 9 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.911612:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894ae00, rc 0) 00000100:00100000:3.0:1790779251.911706:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+8:15571:x1877767642807936:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 511us (1086us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1790779251.911715:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:0.0:1790779251.916723:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779251.916839:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642808192 00000100:00100000:1.0:1790779251.917117:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642808192 00000100:00100000:1.0:1790779251.917229:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:1.0:1790779251.917242:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+8:15571:x1877767642808192:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:1.0:1790779251.917335:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779251.917369:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a400/0xb1aa4014e936e2d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c81 expref: 8 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779251.917396:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:1.0:1790779251.917419:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779251.917449:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779251.917465:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779251.917476:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790779251.917736:0:17146:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000861a88d4 reply state 00000000dfdb338a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779251.917753:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779251.917760:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:1.0:1790779251.917763:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790779251.917766:0:17146:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790779251.917775:0:17146:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790779251.917939:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+9:15571:x1877767642808192:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 698us (1228us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790779251.917948:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:0.0:1790779251.931573:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779251.933383:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642808448 00000100:00100000:2.0:1790779251.933404:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642808448 00000100:00100000:2.0:1790779251.933491:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1790779251.933503:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10cb4944-c4c7-43b5-9787-d954585b459c+9:15571:x1877767642808448:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779251.933875:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10cb4944-c4c7-43b5-9787-d954585b459c+10:15571:x1877767642808448:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 373us (2316us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790779251.934622:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1790779251.937387:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779251.937550:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642808704 00000100:00100000:0.0:1790779251.937563:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642808704 00000100:00100000:0.0:1790779251.937642:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:0.0:1790779251.937655:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cb4944-c4c7-43b5-9787-d954585b459c+10:15571:x1877767642808704:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1790779251.937690:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779251.937714:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e2ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c8f expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.937812:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e2f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.937832:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.937846:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.937859:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e2fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.937947:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.937955:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779251.938106:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790779251.938203:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938213:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e2f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938220:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938227:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779251.938232:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938241:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e2f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938263:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7707e69900) 00010000:00010000:0.0:1790779251.938266:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779251.938272:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e2f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938279:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e2f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938307:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938314:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e2fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938321:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e2fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938326:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779251.938330:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e2fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938336:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e2fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938345:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b7712a97400) 00010000:00010000:0.0:1790779251.938348:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779251.938351:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e2fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938357:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e2fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938398:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e2ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c8f expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938409:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7707e69900) 00010000:00010000:0.0:1790779251.938412:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790779251.938422:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e2ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c8f expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779251.938433:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034aea00, rc 0) 00000100:00100000:0.0:1790779251.938513:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cb4944-c4c7-43b5-9787-d954585b459c+11:15571:x1877767642808704:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 861us (1141us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1790779251.938522:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:1.0:1790779251.947705:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779251.947809:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642808832 00000100:00100000:3.0:1790779251.947824:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642808832 00000100:00100000:3.0:1790779251.947957:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:3.0:1790779251.947969:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cb4944-c4c7-43b5-9787-d954585b459c+11:15571:x1877767642808832:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779251.948001:0:19938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779251.948027:0:19938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e30a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c96 expref: -99 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.948150:0:19938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.948168:0:19938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.948181:0:19938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779251.948209:0:19938:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790779251.948213:0:19938:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779251.948237:0:19938:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.948506:0:19938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e30a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c96 expref: 13 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.948552:0:19938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c96 expref: 12 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779251.948562:0:19938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:3.0:1790779251.948565:0:19938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779251.948569:0:19938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894a000, rc 0) 00000100:00100000:2.0:1790779251.948715:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cb4944-c4c7-43b5-9787-d954585b459c+12:15571:x1877767642808832:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 747us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779251.948725:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:1.0:1790779251.975022:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779251.975301:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642808960 00000100:00100000:2.0:1790779251.975314:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642808960 00000100:00100000:2.0:1790779251.975387:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:2.0:1790779251.975400:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10cb4944-c4c7-43b5-9787-d954585b459c+12:15571:x1877767642808960:12345-192.168.203.3@tcp:37:lfs.0 00000100:00100000:2.0:1790779251.984181:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10cb4944-c4c7-43b5-9787-d954585b459c+12:15571:x1877767642808960:12345-192.168.203.3@tcp:37:lfs.0 Request processed in 8765us (9154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779251.984199:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:1.0:1790779251.995794:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779251.995941:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642809216 00000100:00100000:3.0:1790779251.995954:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642809216 00000100:00100000:3.0:1790779251.996031:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1790779251.996044:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7601dd9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10cb4944-c4c7-43b5-9787-d954585b459c+12:15571:x1877767642809216:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779251.997871:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7601dd9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10cb4944-c4c7-43b5-9787-d954585b459c+13:15571:x1877767642809216:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 1816us (2077us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1790779251.997903:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:1.0:1790779252.109583:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779252.109766:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642809344 00000100:00100000:0.0:1790779252.109778:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642809344 00000100:00100000:0.0:1790779252.109958:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:0.0:1790779252.109973:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+11:15577:x1877767642809344:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1790779252.110008:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779252.110042:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425c9d expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110163:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e31f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110189:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e31f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110206:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e31f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110220:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e326 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110229:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110235:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110404:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af200/0xb1aa4014e936e32d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110417:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af200/0xb1aa4014e936e32d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110424:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af200/0xb1aa4014e936e32d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779252.110476:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790779252.110480:0:17148:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779252.110543:0:17148:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af200/0xb1aa4014e936e32d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110560:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e31f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110568:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e31f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110574:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e31f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110581:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779252.110586:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e31f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110594:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e31f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110609:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7707e69900) 00010000:00010000:0.0:1790779252.110619:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779252.110627:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e31f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110634:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e31f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110653:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110660:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e326 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110666:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e326 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110671:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779252.110674:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e326 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110680:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e326 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110687:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b7712a97400) 00010000:00010000:0.0:1790779252.110690:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779252.110693:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e326 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110698:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e326 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110731:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c9d expref: 13 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110759:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af200/0xb1aa4014e936e32d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c9d expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.110768:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:0.0:1790779252.110770:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790779252.110773:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034af200, rc 0) 00000100:00100000:0.0:1790779252.110854:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+12:15577:x1877767642809344:12345-192.168.203.3@tcp:101:bash.0 Request processed in 887us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779252.110862:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00080000:2.0:1790779252.114006:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779252.127079:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779252.133717:0:17158:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642809472 00000100:00100000:2.0:1790779252.133741:0:17158:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642809472 00000100:00100000:2.0:1790779252.133993:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1790779252.134009:0:17158:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:15577:x1877767642809472:12345-192.168.203.3@tcp:900:bash.0 00000100:00100000:2.0:1790779252.134136:0:17158:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:15577:x1877767642809472:12345-192.168.203.3@tcp:900:bash.0 Request processed in 133us (7891us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779252.134145:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00080000:0.0:1790779252.134213:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779252.143467:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779252.143624:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642809728 00000100:00100000:0.0:1790779252.143639:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642809728 00000100:00100000:0.0:1790779252.143772:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:0.0:1790779252.143785:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+12:15577:x1877767642809728:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1790779252.143814:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779252.143841:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e334 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ca4 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.144157:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.144177:0:17146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c96 expref: 12 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.144188:0:17146:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.144257:0:17146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c96 expref: 12 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.144284:0:17146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c96 expref: 12 pid: 19938 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779252.144302:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17146:1877767663858688:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779252.144429:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7707546a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779252.149608:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17146:1877767663858688:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779252.149653:0:17146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779252.150739:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779252.151136:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642809856 00000100:00100000:0.0:1790779252.151158:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642809856 00010000:00010000:0.0:1790779252.151240:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c96 expref: 13 pid: 19938 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779252.151292:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:0.0:1790779252.151303:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10cb4944-c4c7-43b5-9787-d954585b459c+13:2400:x1877767642809856:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779252.151321:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779252.151329:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c96 expref: 13 pid: 19938 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.151343:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c96 expref: 13 pid: 19938 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.151395:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894a000/0xb1aa4014e936e311 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c96 expref: 13 pid: 19938 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.151418:0:17131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:0.0:1790779252.151423:0:17131:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.151435:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.151444:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.151530:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779252.151603:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10cb4944-c4c7-43b5-9787-d954585b459c+12:2400:x1877767642809856:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 301us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779252.151611:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00080000:2.0:1790779252.151727:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790779252.152814:0:17146:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779252.152833:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.157009:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.157068:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.158083:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.159541:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e349 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.159569:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e349 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.159581:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e349 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779252.159596:0:17146:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790779252.159634:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.159642:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.159764:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.159771:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779252.159776:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.159786:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.159825:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:1.0:1790779252.159828:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779252.159835:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.159842:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae800/0xb1aa4014e936e33b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790779252.159862:0:17146:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fa3a48bb reply state 00000000e38c15f2 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.159875:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.159931:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b771d81a700) 00010000:00010000:1.0:1790779252.159934:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779252.159938:0:17146:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790779252.159990:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e334 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ca4 expref: 15 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.160007:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e349 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ca4 expref: 14 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.160016:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:1.0:1790779252.160019:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1790779252.160021:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6000, rc 0) 00000100:00100000:1.0:1790779252.160142:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+15:15577:x1877767642809728:12345-192.168.203.3@tcp:101:bash.0 Request processed in 16359us (16882us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790779252.160162:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:3.0:1790779252.186373:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779252.186675:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642809984 00000100:00100000:0.0:1790779252.186689:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642809984 00000100:00100000:0.0:1790779252.186765:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:0.0:1790779252.186775:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+15:15577:x1877767642809984:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1790779252.186809:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779252.186838:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e357 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cab expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.187043:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.187082:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.187093:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779252.187145:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790779252.188343:0:17148:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779252.188395:0:17148:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.188414:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.188459:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e357 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cab expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.188483:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cab expref: 16 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.188493:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:0.0:1790779252.188496:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790779252.188501:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034af400, rc 0) 00000100:00100000:0.0:1790779252.188589:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+16:15577:x1877767642809984:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1814us (2231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779252.188598:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:0.0:1790779252.196049:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779252.198154:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642810240 00000100:00100000:2.0:1790779252.198176:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642810240 00000100:00100000:2.0:1790779252.198269:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:2.0:1790779252.198304:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+16:15577:x1877767642810240:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:2.0:1790779252.198995:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+17:15577:x1877767642810240:12345-192.168.203.3@tcp:35:bash.0 Request processed in 691us (2959us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1790779252.199005:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00010000:00010000:3.0:1790779252.265699:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779252.300530:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779252.300646:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642810496 00000100:00100000:3.0:1790779252.300660:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642810496 00000100:00100000:3.0:1790779252.300736:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:3.0:1790779252.300749:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+17:15587:x1877767642810496:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1790779252.300781:0:19938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779252.300831:0:19938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cb2 expref: -99 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779252.301138:0:19938:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790779252.301275:0:19938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e365 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cb2 expref: 19 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779252.301293:0:19938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7707e69900) 00010000:00010000:3.0:1790779252.301296:0:19938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790779252.301302:0:19938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cb2 expref: 19 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779252.301320:0:19938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894ae00, rc 0) 00000100:00100000:3.0:1790779252.301446:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+18:15587:x1877767642810496:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 699us (931us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1790779252.301455:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:1.0:1790779252.306030:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779252.306131:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642810752 00000100:00100000:2.0:1790779252.306144:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642810752 00000100:00100000:2.0:1790779252.306213:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1790779252.306226:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+18:15587:x1877767642810752:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779252.306552:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+19:15587:x1877767642810752:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 327us (536us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1790779252.306561:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:1.0:1790779252.331002:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779252.331046:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663858816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779252.331162:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779252.331522:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663858816 00000100:00100000:0.0:1790779252.331535:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663858816 00000100:00100000:0.0:1790779252.331657:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790779252.331669:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663858816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779252.331703:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790779252.331770:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663858816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779252.331778:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790779252.332252:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663858816:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790779252.332775:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779252.354316:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779252.354573:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642811008 00000100:00100000:1.0:1790779252.354588:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642811008 00000100:00100000:1.0:1790779252.354678:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:1.0:1790779252.354693:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+19:15590:x1877767642811008:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779252.354737:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779252.354772:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936e373 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cb9 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.355431:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936e37a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.355453:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936e37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.355469:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936e37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779252.355484:0:17147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790779252.355695:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6c00/0xb1aa4014e936e373 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cb9 expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.355717:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936e37a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cb9 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.355749:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:1.0:1790779252.355753:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790779252.355757:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7800, rc 0) 00000100:00100000:1.0:1790779252.356473:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+21:15590:x1877767642811008:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1779us (2172us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1790779252.356485:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:1.0:1790779252.363119:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779252.363234:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779252.363399:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642811136 00000100:00100000:3.0:1790779252.363412:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642811136 00000100:00100000:3.0:1790779252.363494:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1790779252.363505:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+21:2401:x1877767642811136:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779252.363524:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779252.363564:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936e37a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cb9 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779252.363587:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:3.0:1790779252.363593:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779252.363662:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+20:2401:x1877767642811136:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 159us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779252.363692:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1790779252.365388:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642811264 00000100:00100000:0.0:1790779252.365404:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642811264 00000100:00100000:0.0:1790779252.365519:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:0.0:1790779252.365532:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+20:15590:x1877767642811264:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1790779252.365639:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e388 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.365660:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.365672:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.365717:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.365726:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e388 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.365734:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e388 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.365742:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034afa00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779252.365764:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e388 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.365773:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e388 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.365787:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:0.0:1790779252.365791:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790779252.365797:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e388 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.365804:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e388 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779252.365964:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+20:15590:x1877767642811264:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 434us (3127us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779252.365973:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:1.0:1790779252.370964:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779252.371400:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642811520 00000100:00100000:3.0:1790779252.371414:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642811520 00000100:00100000:3.0:1790779252.371491:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:3.0:1790779252.371504:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+20:15590:x1877767642811520:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779252.371856:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+21:15590:x1877767642811520:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 352us (914us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1790779252.371868:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1790779252.696971:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779252.697231:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642811776 00000100:00100000:0.0:1790779252.697244:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642811776 00000100:00100000:0.0:1790779252.697330:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:0.0:1790779252.697342:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+21:15621:x1877767642811776:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:0.0:1790779252.697375:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779252.697403:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e38f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cc0 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.697552:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e396 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.697570:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.697610:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779252.697625:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790779252.697784:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034afa00/0xb1aa4014e936e38f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cc0 expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.697805:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e396 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cc0 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.697814:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:0.0:1790779252.697817:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790779252.697820:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034aea00, rc 0) 00000100:00100000:0.0:1790779252.697986:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+23:15621:x1877767642811776:12345-192.168.203.3@tcp:101:cat.0 Request processed in 645us (1028us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1790779252.697998:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:1.0:1790779252.702774:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779252.702839:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779252.703135:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642811904 00000100:00100000:2.0:1790779252.703148:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642811904 00000100:00100000:2.0:1790779252.703235:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:2.0:1790779252.703247:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+23:2400:x1877767642811904:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779252.703269:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779252.703309:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aea00/0xb1aa4014e936e396 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cc0 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.703333:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:2.0:1790779252.703339:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779252.703520:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+22:2400:x1877767642811904:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 275us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779252.703530:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:3.0:1790779252.703741:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642812160 00000100:00100000:3.0:1790779252.703747:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642812160 00000100:00100000:3.0:1790779252.703790:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1790779252.703798:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+22:15621:x1877767642812160:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:3.0:1790779252.704185:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+23:15621:x1877767642812160:12345-192.168.203.3@tcp:35:cat.0 Request processed in 387us (1344us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1790779252.704193:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1790779252.785945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779252.786165:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642812416 00000100:00100000:2.0:1790779252.786197:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642812416 00000100:00100000:2.0:1790779252.786275:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:2.0:1790779252.786287:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+23:15627:x1877767642812416:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1790779252.786320:0:19938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779252.786352:0:19938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671c00/0xb1aa4014e936e3a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cc7 expref: -99 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.786519:0:19938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.786537:0:19938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e349 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ca4 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.786548:0:19938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cab expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.786558:0:19938:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.786603:0:19938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cab expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.786619:0:19938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cab expref: 24 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779252.786637:0:19938:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19938:1877767663858944:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779252.787083:0:19938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e349 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ca4 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.787113:0:19938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e349 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ca4 expref: 24 pid: 17146 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779252.787124:0:19938:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77041a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19938:1877767663859072:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779252.787169:0:19938:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b7283c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779252.789589:0:19938:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19938:1877767663858944:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779252.789610:0:19938:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77041a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19938:1877767663859072:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779252.789643:0:19938:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779252.797357:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779252.797416:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779252.798022:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642812544 00000100:00100000:1.0:1790779252.798038:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642812544 00010000:00010000:1.0:1790779252.798097:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cab expref: 25 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779252.798144:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642812672 00000100:00100000:1.0:1790779252.798147:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642812672 00010000:00010000:1.0:1790779252.798161:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e349 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ca4 expref: 26 pid: 17146 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779252.798177:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1790779252.798188:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+26:2401:x1877767642812544:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779252.798206:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779252.798214:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cab expref: 26 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.798262:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cab expref: 26 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.798290:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af400/0xb1aa4014e936e35e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cab expref: 26 pid: 17148 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.798311:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:1.0:1790779252.798317:0:17133:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.798326:0:17133:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.798334:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779252.798414:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+25:2401:x1877767642812544:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 227us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779252.798422:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1790779252.798442:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1790779252.798449:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603aae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+24:2401:x1877767642812672:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779252.798458:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779252.798463:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e349 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ca4 expref: 24 pid: 17146 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.798472:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e349 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ca4 expref: 24 pid: 17146 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.798498:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e349 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ca4 expref: 24 pid: 17146 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.798508:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:1.0:1790779252.798512:0:17133:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.798521:0:17133:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.798529:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.798559:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779252.798582:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603aae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+23:2401:x1877767642812672:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 133us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779252.798589:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00010000:00010000:2.0:1790779252.799025:0:19938:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.799036:0:19938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779252.799060:0:19938:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790779252.799260:0:19938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671c00/0xb1aa4014e936e3a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cc7 expref: 24 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.799279:0:19938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cc7 expref: 23 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.799286:0:19938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:2.0:1790779252.799289:0:19938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790779252.799292:0:19938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602670400, rc 0) 00000100:00100000:2.0:1790779252.799339:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+23:15627:x1877767642812416:12345-192.168.203.3@tcp:101:dd.0 Request processed in 13055us (13408us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1790779252.799347:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:1.0:1790779252.808550:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779252.808699:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642812800 00000100:00100000:0.0:1790779252.808713:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642812800 00000100:00100000:0.0:1790779252.808793:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:0.0:1790779252.808805:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+23:15627:x1877767642812800:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:0.0:1790779252.808848:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779252.808876:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e3b9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cce expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.809083:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af000/0xb1aa4014e936e3c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.809123:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af000/0xb1aa4014e936e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.809136:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af000/0xb1aa4014e936e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.809393:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e3b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cce expref: 25 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.809415:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af000/0xb1aa4014e936e3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cce expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.809425:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:0.0:1790779252.809429:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790779252.809434:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034af000, rc 0) 00000100:00100000:0.0:1790779252.809552:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+24:15627:x1877767642812800:12345-192.168.203.3@tcp:101:dd.0 Request processed in 749us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779252.809560:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:1.0:1790779252.817729:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779252.818007:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642813056 00000100:00100000:0.0:1790779252.818020:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642813056 00000100:00100000:0.0:1790779252.818099:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:0.0:1790779252.818110:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+24:15627:x1877767642813056:12345-192.168.203.3@tcp:36:dd.0 00010000:00010000:0.0:1790779252.818722:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.818745:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.818781:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790779252.818833:0:17146:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1790779252.818858:0:17146:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a3c3137c reply state 00000000183c85ed transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.818872:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.818931:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:0.0:1790779252.818935:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790779252.818940:0:17146:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790779252.819059:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+27:15627:x1877767642813056:12345-192.168.203.3@tcp:36:dd.0 Request processed in 948us (1342us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1790779252.819068:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000020:00080000:0.0:1790779252.819074:0:17146:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790779252.822421:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779252.822538:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642813184 00000100:00100000:0.0:1790779252.822551:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642813184 00000100:00100000:0.0:1790779252.822628:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:0.0:1790779252.822640:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+27:15627:x1877767642813184:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:0.0:1790779252.822673:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779252.822702:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e3ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cd5 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.822775:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e3ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cd5 expref: 28 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.822792:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e3ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cd5 expref: 28 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779252.822849:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:0.0:1790779252.822853:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790779252.822857:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034ae000, rc 0) 00000100:00100000:0.0:1790779252.822982:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+28:15627:x1877767642813184:12345-192.168.203.3@tcp:101:dd.0 Request processed in 344us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779252.822990:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:1.0:1790779252.836229:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779252.836611:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642813440 00000100:00100000:2.0:1790779252.836625:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642813440 00000100:00100000:2.0:1790779252.836713:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1790779252.836725:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+28:15627:x1877767642813440:12345-192.168.203.3@tcp:103:dd.0 00010000:00010000:2.0:1790779252.836745:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779252.836775:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae000/0xb1aa4014e936e3ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cd5 expref: 28 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779252.836799:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:2.0:1790779252.836805:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779252.836944:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+27:15627:x1877767642813440:12345-192.168.203.3@tcp:103:dd.0 Request processed in 220us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779252.836953:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:1.0:1790779252.840241:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663859200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779252.840337:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779252.842270:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663859200 00000100:00100000:2.0:1790779252.842289:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663859200 00000100:00100000:2.0:1790779252.842368:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790779252.842380:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663859200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779252.842431:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790779252.842536:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663859200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779252.842543:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790779252.842621:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663859200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779252.846045:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779252.846075:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663859328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779252.846169:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779252.846349:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663859328 00000100:00100000:2.0:1790779252.846361:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663859328 00000100:00100000:2.0:1790779252.846435:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790779252.846446:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663859328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790779252.846494:0:18106:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790779252.846555:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663859328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779252.846563:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790779252.846617:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663859328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779252.847207:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779252.847350:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642813568 00000100:00100000:3.0:1790779252.847357:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642813568 00000100:00100000:3.0:1790779252.847442:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:3.0:1790779252.847452:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+27:15627:x1877767642813568:12345-192.168.203.3@tcp:58:dd.0 00010000:00010000:3.0:1790779252.847587:0:19938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779252.847610:0:19938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779252.847623:0:19938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790779252.848832:0:19938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779252.849394:0:19938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1790779252.849549:0:19938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1790779252.849684:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+27:15627:x1877767642813568:12345-192.168.203.3@tcp:58:dd.0 Request processed in 2227us (2475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779252.849708:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:3.0:1790779252.852365:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779252.852434:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642813696 00000100:00100000:1.0:1790779252.852446:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642813696 00000100:00100000:1.0:1790779252.852516:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:1.0:1790779252.852529:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+27:15627:x1877767642813696:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:1.0:1790779252.852556:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779252.852584:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936e3dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cdc expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.852655:0:17147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.852669:0:17147:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936e3dc lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cdc expref: 28 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.852694:0:17147:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.852709:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936e3dc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cdc expref: 28 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.852727:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:1.0:1790779252.852730:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779252.852733:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936e3dc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cdc expref: 28 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779252.852742:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7600, rc 0) 00000100:00100000:1.0:1790779252.853366:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+28:15627:x1877767642813696:12345-192.168.203.3@tcp:101:dd.0 Request processed in 836us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779252.853390:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00010000:00010000:2.0:1790779253.288294:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779253.355119:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663859712:0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.355214:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779253.355256:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663860224:0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.355282:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779253.355302:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663860736:0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.355328:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779253.355355:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790779253.355361:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663859584:0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.355388:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779253.355403:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663860096:0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.355456:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779253.355472:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663860608:0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.355504:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779253.355539:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663859712 00000100:00100000:1.0:1790779253.355547:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663859712 00000100:00100000:1.0:1790779253.355610:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663860224 00000100:00100000:1.0:1790779253.355613:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663860224 00000100:00100000:1.0:1790779253.355633:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790779253.355643:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663859712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.355705:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663859712:12345-0@lo:400:kworker.0 Request processed in 62us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779253.355714:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790779253.355731:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790779253.355738:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663860224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.355776:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663860224:12345-0@lo:400:kworker.0 Request processed in 39us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779253.355783:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790779253.355835:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663859712:0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.355846:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663860224:0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.355877:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663860736 00000100:00100000:1.0:1790779253.355921:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663860736 00000100:00100000:1.0:1790779253.355952:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663860608 00000100:00100000:1.0:1790779253.355955:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663860608 00000100:00100000:1.0:1790779253.355980:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790779253.355988:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663860736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.356023:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663860736:12345-0@lo:400:kworker.0 Request processed in 36us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779253.356030:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790779253.356042:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790779253.356048:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663860608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.356071:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663860608:12345-0@lo:400:kworker.0 Request processed in 24us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779253.356077:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790779253.356100:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663860608:0@lo:400:kworker.0 00010000:00080000:1.0:1790779253.356114:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b772fe25f80 x1877767663860736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779253.356126:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663860736:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.358447:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663859584 00000100:00100000:2.0:1790779253.358470:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663859584 00000100:00100000:2.0:1790779253.358578:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663860096 00000100:00100000:2.0:1790779253.358582:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663860096 00000100:00100000:2.0:1790779253.358609:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790779253.358622:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663859584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.358788:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663859584:12345-0@lo:400:kworker.0 Request processed in 167us (3397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.358797:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790779253.358819:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790779253.358825:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663860096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.358857:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663860096:12345-0@lo:400:kworker.0 Request processed in 34us (3401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.358863:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1790779253.358957:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779253.358965:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779253.358969:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779253.358991:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663859840:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359040:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779253.359100:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663860352:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359125:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779253.359145:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663860864:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359172:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779253.359197:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1790779253.359205:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663859456:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359235:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779253.359266:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663859968:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359288:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779253.359306:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663860480:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359325:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779253.359335:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663860992:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359353:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779253.359375:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663859840 00000100:00100000:2.0:1790779253.359381:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663859840 00000100:00100000:2.0:1790779253.359416:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663860352 00000100:00100000:2.0:1790779253.359419:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663860352 00000100:00100000:2.0:1790779253.359432:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790779253.359438:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663859840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359476:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663859840:12345-0@lo:400:kworker.0 Request processed in 37us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.359482:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790779253.359493:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790779253.359499:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77041a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663860352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359525:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77041a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663860352:12345-0@lo:400:kworker.0 Request processed in 26us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.359540:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1790779253.359554:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779253.359603:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663859840:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359616:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663860352:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359642:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663860864 00000100:00100000:2.0:1790779253.359645:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663860864 00000100:00100000:2.0:1790779253.359671:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663859968 00000100:00100000:2.0:1790779253.359674:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663859968 00000100:00100000:2.0:1790779253.359684:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663860480 00000100:00100000:2.0:1790779253.359686:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663860480 00000100:00100000:2.0:1790779253.359694:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663860992 00000100:00100000:2.0:1790779253.359697:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663860992 00000100:00100000:2.0:1790779253.359711:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790779253.359716:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663860864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359753:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663860864:12345-0@lo:400:kworker.0 Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.359759:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790779253.359771:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790779253.359777:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663859968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359803:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663859968:12345-0@lo:400:kworker.0 Request processed in 27us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.359809:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790779253.359820:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790779253.359825:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663860480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359851:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663860480:12345-0@lo:400:kworker.0 Request processed in 26us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.359867:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790779253.359924:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790779253.359930:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663860992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.359959:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663860992:12345-0@lo:400:kworker.0 Request processed in 30us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.359965:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1790779253.359980:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779253.359983:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779253.360002:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663859968:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.360012:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663860480:0@lo:400:kworker.0 00010000:00080000:2.0:1790779253.360025:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b772fe27100 x1877767663860992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779253.360035:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663860992:0@lo:400:kworker.0 00000100:00100000:2.0:1790779253.360045:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663860864:0@lo:400:kworker.0 00000100:00100000:0.0:1790779253.364154:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663861120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779253.364248:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779253.364329:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779253.364336:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b77108a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663861248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779253.364361:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779253.364418:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663859456 00000100:00100000:0.0:1790779253.364428:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663859456 00000100:00100000:0.0:1790779253.364485:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790779253.364495:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3651:x1877767663859456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779253.364564:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3651:x1877767663859456:12345-0@lo:400:kworker.0 Request processed in 69us (5327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779253.364572:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790779253.364610:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663861120 00000100:00100000:0.0:1790779253.364614:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663861120 00000100:00100000:0.0:1790779253.364632:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663861248 00000100:00100000:0.0:1790779253.364633:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663861248 00000100:00100000:0.0:1790779253.364645:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790779253.364652:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663861120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779253.364725:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779253.364769:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663861120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779253.364776:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790779253.364789:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790779253.364795:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663861248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779253.364804:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779253.364826:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663861248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779253.364831:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790779253.364873:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b77108a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663861248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779253.364947:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663861120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779253.364990:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663859456:0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.365418:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663859584:0@lo:400:kworker.0 00000100:00100000:1.0:1790779253.365449:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663860096:0@lo:400:kworker.0 00000040:00080000:1.0:1790779253.736156:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790779253.736169:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790779253.736198:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790779253.736212:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790779253.736408:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17181:1877767663861376:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790779253.736529:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779253.752678:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.752787:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642813824 00000100:00100000:2.0:1790779253.752800:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642813824 00000100:00100000:2.0:1790779253.752944:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:2.0:1790779253.752958:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+29:15628:x1877767642813824:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790779253.753000:0:17147:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790779253.753168:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+29:15628:x1877767642813824:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 212us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.753176:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:1.0:1790779253.753722:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17181:1877767663861376:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790779253.772277:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779253.781423:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642813952 00000100:00100000:0.0:1790779253.781448:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642813952 00000100:00100000:0.0:1790779253.781672:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1790779253.781685:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+28:15628:x1877767642813952:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790779253.781780:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aee00/0xb1aa4014e936e3e3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.781802:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aee00/0xb1aa4014e936e3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.781815:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aee00/0xb1aa4014e936e3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.781852:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e3ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.781861:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e3ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.781868:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e3ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.781939:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e3f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.781951:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.781959:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779253.782023:0:17146:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790779253.782028:0:17146:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779253.782043:0:17146:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782056:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aee00/0xb1aa4014e936e3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782063:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aee00/0xb1aa4014e936e3e3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782071:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aee00/0xb1aa4014e936e3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782087:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034aee00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779253.782093:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aee00/0xb1aa4014e936e3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782101:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aee00/0xb1aa4014e936e3e3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782127:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603616a00) 00010000:00010000:0.0:1790779253.782131:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779253.782136:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aee00/0xb1aa4014e936e3e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782142:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aee00/0xb1aa4014e936e3e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782159:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e3ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782165:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e3ea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782179:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e3ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782184:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034aec00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779253.782187:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e3ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782193:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e3ea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782212:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b7603616500) 00010000:00010000:0.0:1790779253.782214:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779253.782217:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e3ea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782223:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e3ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782240:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782245:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e3f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782251:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782256:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779253.782259:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782265:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e3f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782273:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:0.0:1790779253.782275:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779253.782278:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e3f1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.782283:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e3f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779253.782415:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+28:15628:x1877767642813952:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 730us (10150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779253.782423:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1790779253.785499:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.800286:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642814208 00000100:00100000:2.0:1790779253.800335:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642814208 00000100:00100000:2.0:1790779253.800601:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:2.0:1790779253.800615:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+28:15628:x1877767642814208:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779253.800645:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779253.800683:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671800/0xb1aa4014e936e3f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ce3 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.800820:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e3ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.800842:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e3ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.800856:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e3ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779253.800900:0:17148:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790779253.801026:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e3ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.801036:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e3ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.801045:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e3ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.801052:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779253.801058:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e3ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.801066:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e3ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.801091:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:2.0:1790779253.801094:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790779253.801101:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e3ff lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.801108:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e3ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.801164:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671800/0xb1aa4014e936e3f8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ce3 expref: 30 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.801175:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603616a00) 00010000:00010000:2.0:1790779253.801188:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779253.801193:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671800/0xb1aa4014e936e3f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ce3 expref: 30 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.801204:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602671800, rc 0) 00000100:00100000:2.0:1790779253.801294:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+29:15628:x1877767642814208:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 682us (15811us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1790779253.801303:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:1.0:1790779253.811567:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779253.811672:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642814336 00000100:00100000:3.0:1790779253.811687:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642814336 00000100:00100000:3.0:1790779253.811769:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:3.0:1790779253.811781:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+29:15628:x1877767642814336:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790779253.811835:0:19938:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790779253.812071:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+29:15628:x1877767642814336:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 291us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779253.812080:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:3.0:1790779253.816363:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.816568:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642814592 00000100:00100000:2.0:1790779253.816583:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642814592 00000100:00100000:2.0:1790779253.816668:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1790779253.816680:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+29:15628:x1877767642814592:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779253.816710:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779253.816738:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e40d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cea expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790779253.817396:0:17148:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1790779253.817406:0:17148:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1790779253.817433:0:17148:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1790779253.817630:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671600/0xb1aa4014e936e414 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.817650:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671600/0xb1aa4014e936e414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.817665:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671600/0xb1aa4014e936e414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.817738:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e40d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cea expref: 32 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.817760:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671600/0xb1aa4014e936e414 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cea expref: 31 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.817771:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97c00) 00010000:00010000:2.0:1790779253.817774:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779253.817779:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602671600, rc 0) 00000100:00100000:2.0:1790779253.817868:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+31:15628:x1877767642814592:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1190us (1521us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1790779253.817945:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1790779253.830475:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779253.830670:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642814848 00000100:00100000:0.0:1790779253.830683:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642814848 00000100:00100000:0.0:1790779253.830764:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:0.0:1790779253.830775:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+31:15628:x1877767642814848:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790779253.830850:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779253.830949:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671600/0xb1aa4014e936e414 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cea expref: 31 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.830974:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97c00) 00010000:00010000:0.0:1790779253.830991:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779253.833165:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936e422 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.833199:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936e422 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.833214:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936e422 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835393:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e429 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4fce3689 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835446:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e429 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fce3689 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835460:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e429 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fce3689 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835546:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936e422 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835556:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936e422 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835564:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936e422 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835572:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779253.835577:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936e422 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835585:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936e422 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835600:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:2.0:1790779253.835603:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779253.835610:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936e422 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835616:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b800/0xb1aa4014e936e422 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835636:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e429 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fce3689 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835649:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e429 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fce3689 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835656:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e429 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fce3689 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835661:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779253.835665:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e429 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fce3689 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835671:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e429 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fce3689 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835679:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4fce3689 (ffff9b7712a97100) 00010000:00010000:2.0:1790779253.835681:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779253.835684:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e429 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4fce3689 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.835689:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e429 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4fce3689 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779253.835842:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+30:15628:x1877767642814848:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 5062us (5376us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790779253.835861:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:1.0:1790779253.838483:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.838744:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642814976 00000100:00100000:2.0:1790779253.838758:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642814976 00000100:00100000:2.0:1790779253.838835:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:2.0:1790779253.838846:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+30:15628:x1877767642814976:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779253.838924:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779253.838972:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e430 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cf1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.839031:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671a00/0xb1aa4014e936e437 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.839048:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671a00/0xb1aa4014e936e437 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.839061:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671a00/0xb1aa4014e936e437 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.839203:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e430 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf1 expref: 32 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.839226:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671a00/0xb1aa4014e936e437 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf1 expref: 31 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.839237:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:2.0:1790779253.839240:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790779253.839251:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602671a00, rc 0) 00000100:00100000:2.0:1790779253.839346:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+31:15628:x1877767642814976:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 500us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.839354:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:3.0:1790779253.842656:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.842728:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642815232 00000100:00100000:2.0:1790779253.842742:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642815232 00000100:00100000:2.0:1790779253.842823:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:2.0:1790779253.842834:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+31:15628:x1877767642815232:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790779253.843115:0:19938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.843158:0:19938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.843171:0:19938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779253.843535:0:19938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1790779253.843548:0:19938:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 571850666954ns, next at 572850663709ns, rc = 0 00000004:00010000:2.0:1790779253.843612:0:19938:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000728f69e0 reply state 0000000012c199db transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.843629:0:19938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.843639:0:19938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:2.0:1790779253.843643:0:19938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790779253.843648:0:19938:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790779253.843847:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+33:15628:x1877767642815232:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 1011us (1202us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1790779253.843857:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:3.0:1790779253.853663:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.856296:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642815360 00000100:00100000:2.0:1790779253.856318:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642815360 00000100:00100000:2.0:1790779253.856611:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:2.0:1790779253.856625:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+33:15628:x1877767642815360:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779253.856762:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779253.856792:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e445 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cf8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.857848:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e445 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf8 expref: 34 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.857873:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e445 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf8 expref: 34 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.858054:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:2.0:1790779253.858058:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790779253.858063:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602671400, rc 0) 00000100:00100000:2.0:1790779253.858300:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+34:15628:x1877767642815360:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1676us (4652us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.858309:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1790779253.863798:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.868184:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642815488 00000100:00100000:2.0:1790779253.868207:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642815488 00000100:00100000:2.0:1790779253.868347:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1790779253.868360:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642815488:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1790779253.868370:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779253.868748:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2401:x1877767642815488:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 389us (4962us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1790779253.868757:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:3.0:1790779253.878867:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.879945:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642815744 00000100:00100000:2.0:1790779253.879962:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642815744 00000100:00100000:2.0:1790779253.880049:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:2.0:1790779253.880061:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+34:15628:x1877767642815744:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790779253.880396:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+35:15628:x1877767642815744:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 335us (1541us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1790779253.880432:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1790779253.884242:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779253.884445:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642816000 00000100:00100000:0.0:1790779253.884458:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642816000 00000100:00100000:0.0:1790779253.884541:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:0.0:1790779253.884553:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+35:15628:x1877767642816000:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790779253.884714:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+35:15628:x1877767642816000:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 163us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779253.884723:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:1.0:1790779253.887393:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779253.889058:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642816128 00000100:00100000:0.0:1790779253.889080:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642816128 00000100:00100000:0.0:1790779253.891244:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1790779253.891272:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+35:15628:x1877767642816128:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779253.891326:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779253.891465:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e44c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425cff expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.891563:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e453 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.891584:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e453 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.891599:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e453 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779253.891670:0:17148:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779253.891694:0:17148:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e453 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.891725:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae400/0xb1aa4014e936e44c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cff expref: 37 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.891748:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e453 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cff expref: 36 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.891758:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:0.0:1790779253.891761:0:17148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790779253.891765:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034aec00, rc 0) 00000100:00100000:0.0:1790779253.891869:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+36:15628:x1877767642816128:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 610us (4489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779253.891934:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:3.0:1790779253.897869:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779253.898609:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642816256 00000100:00100000:0.0:1790779253.898624:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642816256 00000100:00100000:0.0:1790779253.898753:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1790779253.898765:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+6:2400:x1877767642816256:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779253.898792:0:19170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779253.898822:0:19170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e45a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425d06 expref: -99 pid: 19170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779253.898858:0:19170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd1f75, blocks: 0x0 00010000:00010000:0.0:1790779253.898931:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1790779253.898937:0:19170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779253.898950:0:19170:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e45a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d06 expref: 7 pid: 19170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.898976:0:19170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e45a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d06 expref: 7 pid: 19170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.899005:0:19170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034ae400, rc 0) 00000100:00100000:0.0:1790779253.899098:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:2400:x1877767642816256:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 335us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779253.899107:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1790779253.907094:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.907349:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642816512 00000100:00100000:2.0:1790779253.907362:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642816512 00000100:00100000:2.0:1790779253.907427:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:2.0:1790779253.907436:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+36:15628:x1877767642816512:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790779253.907566:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+36:15628:x1877767642816512:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 131us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.907575:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:2.0:1790779253.912429:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779253.912778:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642816640 00000100:00100000:0.0:1790779253.912792:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642816640 00000100:00100000:0.0:1790779253.912922:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:0.0:1790779253.912934:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+36:15628:x1877767642816640:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790779253.916176:0:17126:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1790779253.916195:0:17126:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1790779253.916272:0:17126:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1790779253.917277:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.917310:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.917319:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.917325:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779253.917331:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.917339:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.917359:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:0.0:1790779253.917362:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790779253.917369:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.917375:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e2e7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779253.917582:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+19:15628:x1877767642816640:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 4643us (5169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779253.917594:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1790779253.918724:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779253.918751:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663861504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790779253.918818:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779253.919950:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663861504 00000100:00100000:3.0:1790779253.919967:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663861504 00000100:00100000:3.0:1790779253.920050:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790779253.920061:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663861504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790779253.920266:0:18653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790779253.920270:0:18653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1790779253.920272:0:18653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790779253.920275:0:18653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1790779253 -> 1790779253 00002000:00010000:3.0:1790779253.920278:0:18653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1790779253.920368:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663861504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 309us (1549us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1790779253.920377:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:0.0:1790779253.920949:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760300aa00/2, rc 0, transno 8589934596 00000100:00100000:0.0:1790779253.920958:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663861504:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1790779253.921168:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921183:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921193:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921199:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779253.921204:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921214:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921555:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b7712a97400) 00010000:00010000:2.0:1790779253.921560:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779253.921567:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921597:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671000/0xb1aa4014e936e293 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921626:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921632:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921638:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921643:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779253.921645:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921651:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921659:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:2.0:1790779253.921662:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779253.921665:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921671:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663800/0xb1aa4014e936e29a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921689:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921695:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921707:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921712:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779253.921715:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921721:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921731:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b771d81a700) 00010000:00010000:2.0:1790779253.921732:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779253.921736:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921741:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936e342 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921760:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921766:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921771:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921776:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779253.921778:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921793:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921803:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:2.0:1790779253.921805:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779253.921808:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921813:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae600/0xb1aa4014e936e3c7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921825:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921832:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921838:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921843:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779253.921846:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921852:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921859:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:2.0:1790779253.921862:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790779253.921865:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.921984:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671e00/0xb1aa4014e936e43e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779253.928120:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779253.928296:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642816768 00000100:00100000:1.0:1790779253.928310:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642816768 00000100:00100000:1.0:1790779253.928385:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:1.0:1790779253.928396:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:2401:x1877767642816768:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1790779253.928855:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:2401:x1877767642816768:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 457us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779253.928865:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:1.0:1790779253.933377:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.936722:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642817024 00000100:00100000:2.0:1790779253.936744:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642817024 00000100:00100000:3.0:1790779253.937182:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:3.0:1790779253.937198:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+15:15628:x1877767642817024:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790779253.937352:0:19938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779253.937390:0:19938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034aec00/0xb1aa4014e936e453 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cff expref: 15 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.937649:0:19938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:3.0:1790779253.937656:0:19938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779253.937699:0:19938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.937716:0:19938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.937726:0:19938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779253.938466:0:19938:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000077d3cd00 reply state 0000000021d2d8a0 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.938486:0:19938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.938493:0:19938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:3.0:1790779253.938495:0:19938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790779253.938499:0:19938:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790779253.938676:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+16:15628:x1877767642817024:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 1479us (5310us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1790779253.938684:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:3.0:1790779253.941669:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.942136:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642817152 00000100:00100000:2.0:1790779253.942150:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642817152 00000100:00100000:2.0:1790779253.942228:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:2.0:1790779253.942241:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:15628:x1877767642817152:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779253.942277:0:18653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779253.942307:0:18653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425d0d expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.942349:0:18653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e45a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d06 expref: 8 pid: 19170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.942360:0:18653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779253.942365:0:18653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779253.942375:0:18653:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 8 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.942632:0:18653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e45a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d06 expref: 8 pid: 19170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.942649:0:18653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e45a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d06 expref: 8 pid: 19170 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779253.942688:0:18653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18653:1877767663861632:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779253.942807:0:18653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b774123a480 going to sleep for 11 seconds 00000100:00100000:1.0:1790779253.950499:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779253.950777:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642817280 00000100:00100000:3.0:1790779253.950791:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642817280 00010000:00010000:3.0:1790779253.950855:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e45a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d06 expref: 9 pid: 19170 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779253.951001:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1790779253.951121:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:2401:x1877767642817280:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779253.951145:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790779253.951319:0:18653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18653:1877767663861632:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779253.951361:0:18653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 9 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.951383:0:18653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602671e00, rc 0) 00010000:00010000:3.0:1790779253.951457:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e45a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d06 expref: 9 pid: 19170 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.951474:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e45a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d06 expref: 9 pid: 19170 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779253.951478:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:15628:x1877767642817152:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 9241us (9826us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779253.951487:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00010000:00010000:3.0:1790779253.951504:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e45a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d06 expref: 8 pid: 19170 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.951521:0:17132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779253.951526:0:17132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779253.951534:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 7 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.951546:0:17132:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 7 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.951588:0:17132:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 7 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779253.951620:0:17132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17132:1877767663861760:192.168.203.3@tcp:105: 00000100:00100000:3.0:1790779253.953186:0:17132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779253.959559:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779253.959770:0:17132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17132:1877767663861760:192.168.203.3@tcp:105: 00010000:00010000:3.0:1790779253.959805:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779253.960481:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:2401:x1877767642817280:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 9358us (9990us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779253.960498:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:2.0:1790779253.960724:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642817408 00000100:00100000:2.0:1790779253.960734:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642817408 00000100:00100000:2.0:1790779253.960796:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:2.0:1790779253.960806:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:2400:x1877767642817408:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790779253.962551:0:18654:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790779253.962558:0:18654:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1790779252 00002000:00010000:2.0:1790779253.962561:0:18654:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1790779251 00002000:00010000:2.0:1790779253.962564:0:18654:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1790779253 -> 1790779252 00002000:00010000:2.0:1790779253.962566:0:18654:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790779253.962661:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+8:2400:x1877767642817408:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 1845us (3106us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790779253.962671:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:1.0:1790779253.971490:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.971605:0:18652:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642817536 00000100:00100000:2.0:1790779253.971633:0:18652:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642817536 00000100:00100000:2.0:1790779253.971707:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1790779253.971719:0:18652:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+8:2400:x1877767642817536:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790779253.971779:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.971804:0:18652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 8 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779253.971813:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779253.971818:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790779253.971824:0:18652:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.975394:0:18652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 8 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.975492:0:18652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 8 pid: 18653 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779253.975581:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18652:1877767663861888:192.168.203.3@tcp:104: 00000100:00100000:3.0:1790779253.975759:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779253.986086:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779253.987386:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642817664 00000100:00100000:0.0:1790779253.987404:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642817664 00010000:00010000:0.0:1790779253.987471:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 9 pid: 18653 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779253.987550:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:0.0:1790779253.987561:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:2401:x1877767642817664:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779253.987580:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779253.987607:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 9 pid: 18653 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.987624:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 9 pid: 18653 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.987657:0:17131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790779253.987663:0:17131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790779253.987670:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.987683:0:17131:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779253.987709:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779253.987797:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:2401:x1877767642817664:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 238us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779253.987806:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00010000:00010000:3.0:1790779253.988138:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075432020/0xb1aa4014e936e468 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d0d expref: 8 pid: 18653 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779253.988161:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18652:1877767663861888:192.168.203.3@tcp:104: 00010000:00010000:3.0:1790779253.988259:0:18652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.988272:0:18652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.988293:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.988321:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.988331:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.988342:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.988351:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779253.988356:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.988367:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.988382:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779253.988391:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000453e39cb/0xb1aa4014e936e46f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779253.988469:0:18652:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:2400:x1877767642817536:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 16752us (16994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779253.988478:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:1.0:1790779253.999654:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779253.999795:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642817920 00000100:00100000:2.0:1790779254.000391:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642817920 00000100:00100000:2.0:1790779254.000513:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1790779254.000525:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+16:15628:x1877767642817920:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790779254.000642:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.000665:0:17147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af000/0xb1aa4014e936e3c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cce expref: 16 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.000677:0:17147:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.000721:0:17147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af000/0xb1aa4014e936e3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cce expref: 16 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.000757:0:17147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af000/0xb1aa4014e936e3c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cce expref: 16 pid: 17148 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779254.000774:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17147:1877767663862016:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779254.000931:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b774123ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779254.008319:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779254.008617:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642818048 00000100:00100000:3.0:1790779254.008632:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642818048 00010000:00010000:3.0:1790779254.008712:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af000/0xb1aa4014e936e3c0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cce expref: 17 pid: 17148 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779254.008765:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1790779254.008776:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+17:2401:x1877767642818048:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779254.008795:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779254.008803:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af000/0xb1aa4014e936e3c0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cce expref: 17 pid: 17148 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.008818:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af000/0xb1aa4014e936e3c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cce expref: 17 pid: 17148 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.008848:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:3.0:1790779254.008855:0:17132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936e3dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cdc expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.008868:0:17132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.008877:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.008948:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.008974:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779254.009047:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+17:2401:x1877767642818048:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 272us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779254.009055:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00080000:0.0:1790779254.009225:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790779254.009412:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af000/0xb1aa4014e936e3c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cce expref: 16 pid: 17148 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779254.009433:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17147:1877767663862016:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779254.009458:0:17147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.009469:0:17147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.009481:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.009757:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.009772:0:17147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e445 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf8 expref: 16 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.009782:0:17147:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.009819:0:17147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e445 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf8 expref: 16 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.009849:0:17147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e445 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf8 expref: 16 pid: 17147 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779254.009867:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17147:1877767663862144:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779254.009987:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790779254.013225:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779254.013466:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642818176 00000100:00100000:3.0:1790779254.013479:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642818176 00010000:00010000:3.0:1790779254.013533:0:17133:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e445 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf8 expref: 17 pid: 17147 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779254.013733:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1790779254.013745:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+17:2400:x1877767642818176:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779254.013764:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779254.013773:0:17133:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e445 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf8 expref: 17 pid: 17147 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.013789:0:17133:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e445 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf8 expref: 17 pid: 17147 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.013817:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:3.0:1790779254.013824:0:17133:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.013836:0:17133:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.013865:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.013937:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779254.014005:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+17:2400:x1877767642818176:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 261us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779254.014013:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00010000:00010000:1.0:1790779254.014298:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671400/0xb1aa4014e936e445 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf8 expref: 16 pid: 17147 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779254.014318:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17147:1877767663862144:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779254.014342:0:17147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.014352:0:17147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.014358:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779254.014505:0:17147:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1790779254.014647:0:17147:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1790779254.014688:0:17147:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1790779254.014786:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17147:1877767663862272:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790779254.014851:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779254.014923:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790779254.015695:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663862272 00000100:00100000:0.0:1790779254.015706:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663862272 00000100:00100000:0.0:1790779254.015778:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790779254.015804:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17147:x1877767663862272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790779254.015980:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17147:x1877767663862272:12345-0@lo:1000:mdt00_001.0 Request processed in 176us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779254.015988:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790779254.016514:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17147:1877767663862272:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1790779254.016721:0:17147:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1790779254.016812:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17147:1877767663862400:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790779254.016857:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779254.016929:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7705328000 going to sleep for 11 seconds 00000100:00100000:0.0:1790779254.018047:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663862400 00000100:00100000:0.0:1790779254.018059:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663862400 00000100:00100000:0.0:1790779254.018128:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790779254.018139:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17147:x1877767663862400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790779254.018395:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17147:x1877767663862400:12345-0@lo:1000:mdt00_001.0 Request processed in 256us (1536us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1790779254.018405:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790779254.018971:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17147:1877767663862400:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1790779254.019035:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019048:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019057:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019064:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779254.019070:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019080:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019100:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:1.0:1790779254.019103:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779254.019109:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019116:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7400/0xb1aa4014e936e47d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019156:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019163:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019201:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019207:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ae00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779254.019210:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019217:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019226:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:1.0:1790779254.019229:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779254.019237:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936e3dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cdc expref: 19 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019250:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936e3dc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cdc expref: 19 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019261:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936e3dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cdc expref: 19 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.019335:0:17147:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936e3dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cdc expref: 19 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779254.019353:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17147:1877767663862528:192.168.203.3@tcp:105: 00000100:00100000:1.0:1790779254.019452:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77053280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779254.023729:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779254.024376:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17147:1877767663862528:192.168.203.3@tcp:105: 00010000:00010000:1.0:1790779254.024437:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024451:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ae00/0xb1aa4014e936e3d5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024498:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e484 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024514:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e484 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024529:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e484 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024541:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e484 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024547:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e484 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024554:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e484 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024559:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779254.024564:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e484 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024571:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e484 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024583:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:1.0:1790779254.024586:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779254.024596:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e484 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024602:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6000/0xb1aa4014e936e484 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024614:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024620:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024626:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024631:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602670c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779254.024634:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024640:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024713:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:1.0:1790779254.024717:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790779254.024721:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779254.024728:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670c00/0xb1aa4014e936e476 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779254.025165:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+19:15628:x1877767642817920:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 24639us (25525us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1790779254.025377:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000020:00080000:1.0:1790779254.025396:0:17147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790779254.025589:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790779254.025595:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790779254.025617:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790779254.025624:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790779254.026237:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642818304 00000100:00100000:3.0:1790779254.026250:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642818304 00000100:00100000:3.0:1790779254.026316:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1790779254.026327:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7601dd8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+19:15627:x1877767642818304:12345-192.168.203.3@tcp:49:dd.0 00000100:00100000:3.0:1790779254.026501:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7601dd8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+19:15627:x1877767642818304:12345-192.168.203.3@tcp:49:dd.0 Request processed in 176us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779254.026509:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1790779254.033628:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779254.034971:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642818432 00000100:00100000:2.0:1790779254.034989:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642818432 00000100:00100000:2.0:1790779254.035082:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1790779254.035094:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+19:15627:x1877767642818432:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1790779254.035123:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779254.035152:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671c00/0xb1aa4014e936e48b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425d14 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.035197:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670200/0xb1aa4014e936e492 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.035215:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670200/0xb1aa4014e936e492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.035240:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670200/0xb1aa4014e936e492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.035638:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671c00/0xb1aa4014e936e48b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d14 expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.035666:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670200/0xb1aa4014e936e492 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d14 expref: 20 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.035678:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:2.0:1790779254.035681:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790779254.035685:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602670200, rc 0) 00000100:00100000:2.0:1790779254.035787:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+20:15627:x1877767642818432:12345-192.168.203.3@tcp:101:dd.0 Request processed in 695us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779254.035795:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:1.0:1790779254.041713:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779254.042170:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642818688 00000100:00100000:3.0:1790779254.042193:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642818688 00000100:00100000:3.0:1790779254.042272:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1790779254.042285:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+20:15628:x1877767642818688:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790779254.042646:0:17150:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790779254.042690:0:17150:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1790779254.042726:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936e499 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.042747:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936e499 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.042761:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936e499 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.042783:0:17150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936e499 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.042790:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936e499 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.042797:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936e499 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.042822:0:17150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779254.042843:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779254.042853:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936e499 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.042860:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ba00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779254.042865:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936e499 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.042875:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936e499 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.042955:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:2.0:1790779254.042958:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790779254.042963:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936e499 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.042982:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894ba00/0xb1aa4014e936e499 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.043000:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779254.043002:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779254.043004:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779254.043214:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+22:15628:x1877767642818688:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 930us (1515us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1790779254.043223:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000020:00080000:3.0:1790779254.043230:0:17150:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790779254.254190:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779254.254325:0:18657:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642818816 00000100:00100000:0.0:1790779254.254338:0:18657:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642818816 00000100:00100000:0.0:1790779254.254423:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1790779254.254435:0:18657:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:2400:x1877767642818816:12345-192.168.203.3@tcp:4:dd.0 00002000:00010000:0.0:1790779254.254501:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6abd1f74, atime: 0x6abd1f73, ctime: 0x6abd1f74, blocks: 0x0 00010000:00010000:0.0:1790779254.254514:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e4a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779254.254536:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790779254.254541:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779254.254549:0:18657:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779254.254570:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779254.260230:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779254.260393:0:18659:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1790779254.260404:0:18659:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1790779254.261310:0:18659:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642818944 00000100:00100000:3.0:1790779254.261322:0:18659:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642818944 00000100:00100000:2.0:1790779254.262221:0:20287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:2.0:1790779254.262237:0:20287:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+9:2401:x1877767642818944:12345-192.168.203.3@tcp:4:dd.0 00010000:00010000:2.0:1790779254.262287:0:20287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5abc34e/0xb1aa4014e936e4a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.262310:0:20287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779254.262316:0:20287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779254.262324:0:20287:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5abc34e/0xb1aa4014e936e4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.262341:0:20287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5abc34e/0xb1aa4014e936e4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779254.324029:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790779254.362225:0:18648:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1790779254.362246:0:18648:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1790779254.365743:0:18657:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1790779254.365756:0:18657:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1790779252 -> 1790779253 00002000:00010000:0.0:1790779254.365760:0:18657:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1790779252 -> 1790779253 00002000:00010000:0.0:1790779254.365763:0:18657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1790779254.365785:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779254.365800:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779254.365811:0:18657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e4a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779254.365820:0:18657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779254.365825:0:18657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e4a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779254.365837:0:18657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e4a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779254.365861:0:18657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e4a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779254.365870:0:18657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cebe160/0xb1aa4014e936e4a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779254.366058:0:18657:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+7:2400:x1877767642818816:12345-192.168.203.3@tcp:4:dd.0 Request processed in 111619us (111875us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790779254.366070:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000001:00080000:0.0:1790779254.417545:0:18648:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1790779254.417698:0:20287:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1790779254.417703:0:20287:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1790779254.417719:0:20287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5abc34e/0xb1aa4014e936e4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.417748:0:20287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5abc34e/0xb1aa4014e936e4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.417757:0:20287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5abc34e/0xb1aa4014e936e4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.417764:0:20287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779254.417769:0:20287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5abc34e/0xb1aa4014e936e4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.417778:0:20287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5abc34e/0xb1aa4014e936e4a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.417800:0:20287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5abc34e/0xb1aa4014e936e4a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779254.417807:0:20287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5abc34e/0xb1aa4014e936e4a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779254.418017:0:20287:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2401:x1877767642818944:12345-192.168.203.3@tcp:4:dd.0 Request processed in 155779us (157797us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1790779254.418028:0:20287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00010000:00010000:2.0:1790779255.337922:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779255.484692:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779255.484759:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779255.484806:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779255.484831:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779255.484850:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779255.484869:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779255.484951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779255.484975:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779255.485013:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779255.485130:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642819584 00000100:00100000:2.0:1790779255.485144:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642819584 00000100:00100000:2.0:1790779255.485225:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642820096 00000100:00100000:2.0:1790779255.485247:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642820096 00000100:00100000:2.0:1790779255.485270:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642819456 00000100:00100000:2.0:1790779255.485273:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642819456 00000100:00100000:2.0:1790779255.485288:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642819968 00000100:00100000:2.0:1790779255.485291:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642819968 00000100:00100000:2.0:1790779255.485311:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1790779255.485322:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2399:x1877767642819584:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779255.485424:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2399:x1877767642819584:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 103us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779255.485433:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1790779255.485454:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:2.0:1790779255.485461:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cb4944-c4c7-43b5-9787-d954585b459c+5:2399:x1877767642820096:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779255.485489:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cb4944-c4c7-43b5-9787-d954585b459c+5:2399:x1877767642820096:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779255.485495:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:2.0:1790779255.485507:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:2.0:1790779255.485513:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2399:x1877767642819456:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779255.485540:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2399:x1877767642819456:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779255.485547:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:2.0:1790779255.485560:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:2.0:1790779255.485567:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cb4944-c4c7-43b5-9787-d954585b459c+5:2399:x1877767642819968:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779255.485594:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cb4944-c4c7-43b5-9787-d954585b459c+5:2399:x1877767642819968:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779255.485601:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:2.0:1790779255.485633:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642819328 00000100:00100000:2.0:1790779255.485637:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642819328 00000100:00100000:2.0:1790779255.485664:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642819840 00000100:00100000:2.0:1790779255.485668:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642819840 00000100:00100000:2.0:1790779255.485683:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642819200 00000100:00100000:2.0:1790779255.485686:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642819200 00000100:00100000:2.0:1790779255.485697:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642819712 00000100:00100000:2.0:1790779255.485700:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642819712 00000100:00100000:2.0:1790779255.485716:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:2.0:1790779255.485722:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2399:x1877767642819328:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779255.485754:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2399:x1877767642819328:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779255.485761:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:2.0:1790779255.485774:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:2.0:1790779255.485780:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+5:2399:x1877767642819840:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779255.485828:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+5:2399:x1877767642819840:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 48us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779255.485835:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:2.0:1790779255.485849:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:2.0:1790779255.485855:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77108a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+22:2399:x1877767642819200:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779255.485945:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77108a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+22:2399:x1877767642819200:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 89us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779255.485952:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:2.0:1790779255.485966:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:2.0:1790779255.485972:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:2399:x1877767642819712:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779255.485997:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cb4944-c4c7-43b5-9787-d954585b459c+6:2399:x1877767642819712:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779255.486008:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00080000:0.0:1790779255.486459:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779255.486466:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790779255.486469:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790779255.486473:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779255.486843:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642819072 00000100:00100000:3.0:1790779255.486853:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642819072 00000100:00100000:3.0:1790779255.486952:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 167 00000100:00100000:3.0:1790779255.486962:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2399:x1877767642819072:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779255.487032:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2399:x1877767642819072:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 72us (2359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779255.487039:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 167 00000001:02000400:1.0:1790779256.303297:0:20325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1790779256.360169:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779256.427950:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779256.427973:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663862656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779256.428041:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779256.428091:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663862656 00000100:00100000:1.0:1790779256.428098:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663862656 00000100:00100000:1.0:1790779256.428153:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790779256.428161:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663862656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779256.428190:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790779256.428235:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663862656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779256.428242:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1790779256.428263:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779256.428288:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1790779256.428293:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760300aa00, transno 8589934596 00000004:00080000:1.0:1790779256.428304:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1790779256.428327:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663862656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790779257.384179:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779257.448322:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779257.448347:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663862784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779257.448426:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779257.448686:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663862784 00000100:00100000:2.0:1790779257.448694:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663862784 00000100:00100000:2.0:1790779257.448766:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790779257.448777:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663862784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790779257.448801:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790779257.448852:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663862784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779257.448858:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1790779257.449551:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779257.449598:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663862784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779257.960424:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663862912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779257.960626:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779257.960728:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663862912 00000100:00100000:3.0:1790779257.960738:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663862912 00000100:00100000:3.0:1790779257.960792:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790779257.960802:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663862912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779257.960849:0:18106:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790779257.960940:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663862912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779257.960948:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790779257.961006:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663862912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779257.967915:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663863040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779257.968023:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779257.968330:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663863040 00000100:00100000:0.0:1790779257.968341:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663863040 00000100:00100000:0.0:1790779257.968412:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790779257.968423:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663863040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779257.968472:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1790779257.968550:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663863040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779257.968557:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790779257.968685:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663863040:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1790779258.024867:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779258.408163:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779258.472396:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f89954ec-b1b4-4b66-a198-81b81a38f825:3652:1877767663863168:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.472497:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.472550:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663863680:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.472582:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.472605:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663864192:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.472627:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.472643:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663864704:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.472666:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.472701:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790779258.472707:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663863552:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.472736:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.472755:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663864064:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.472783:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.472802:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663864576:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.472824:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.472870:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663863296:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.472943:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.472965:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663863808:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.472989:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.473009:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663864320:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473035:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.473050:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790779258.473056:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663863424:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473084:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.473104:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663863936:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473125:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.473141:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663864448:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473159:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.473191:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663863680 00000100:00100000:3.0:1790779258.473202:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663863680 00000100:00100000:3.0:1790779258.473251:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663864192 00000100:00100000:3.0:1790779258.473254:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663864192 00000100:00100000:3.0:1790779258.473267:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663864704 00000100:00100000:3.0:1790779258.473269:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663864704 00000100:00100000:3.0:1790779258.473299:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663864576 00000100:00100000:3.0:1790779258.473303:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663864576 00000100:00100000:3.0:1790779258.473318:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663864320 00000100:00100000:3.0:1790779258.473321:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663864320 00000100:00100000:3.0:1790779258.473337:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663864448 00000100:00100000:3.0:1790779258.473339:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663864448 00000100:00100000:3.0:1790779258.473356:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790779258.473367:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663863680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473437:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663863680:12345-0@lo:400:kworker.0 Request processed in 71us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.473452:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790779258.473474:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790779258.473481:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663864192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473516:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663864192:12345-0@lo:400:kworker.0 Request processed in 36us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.473522:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790779258.473534:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790779258.473540:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663864704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473571:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663864704:12345-0@lo:400:kworker.0 Request processed in 31us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.473577:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790779258.473590:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790779258.473596:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663864576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473625:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663864576:12345-0@lo:400:kworker.0 Request processed in 30us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.473631:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790779258.473643:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790779258.473649:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663864320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473684:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663864320:12345-0@lo:400:kworker.0 Request processed in 35us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.473690:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790779258.473702:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790779258.473708:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663864448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473736:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663864448:12345-0@lo:400:kworker.0 Request processed in 27us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.473748:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790779258.473771:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663863552 00000100:00100000:3.0:1790779258.473775:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663863552 00000100:00100000:3.0:1790779258.473794:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663864064 00000100:00100000:3.0:1790779258.473797:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663864064 00000100:00100000:3.0:1790779258.473809:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663863424 00000100:00100000:3.0:1790779258.473811:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663863424 00000100:00100000:3.0:1790779258.473823:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663863936 00000100:00100000:3.0:1790779258.473826:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663863936 00000100:00100000:3.0:1790779258.473836:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790779258.473843:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663863552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473936:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663863552:12345-0@lo:400:kworker.0 Request processed in 93us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.473943:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790779258.473956:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790779258.473962:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663864064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.473991:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663864064:12345-0@lo:400:kworker.0 Request processed in 30us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.473997:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790779258.474008:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790779258.474013:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663863424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474041:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663863424:12345-0@lo:400:kworker.0 Request processed in 28us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.474046:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790779258.474055:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790779258.474060:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663863936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474097:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663863936:12345-0@lo:400:kworker.0 Request processed in 37us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.474103:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790779258.474128:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663863296 00000100:00100000:3.0:1790779258.474131:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663863296 00000100:00100000:3.0:1790779258.474156:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663863808 00000100:00100000:3.0:1790779258.474158:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663863808 00000100:00100000:3.0:1790779258.474171:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790779258.474176:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663863296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474208:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663863296:12345-0@lo:400:kworker.0 Request processed in 31us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.474213:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790779258.474223:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790779258.474228:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663863808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474273:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663863808:12345-0@lo:400:kworker.0 Request processed in 44us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.474279:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1790779258.474310:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790779258.474316:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790779258.474318:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790779258.474322:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790779258.474377:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663863424:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474389:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663863936:0@lo:400:kworker.0 00010000:00080000:3.0:1790779258.474402:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b772fe26300 x1877767663864448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779258.474414:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663864448:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474434:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663863296:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474444:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663863808:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474454:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663864320:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474497:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663863552:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474509:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663864064:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474521:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663864576:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474533:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663863680:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.474544:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663864192:0@lo:400:kworker.0 00010000:00080000:3.0:1790779258.474556:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b768000 x1877767663864704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779258.474566:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663864704:0@lo:400:kworker.0 00000100:00100000:1.0:1790779258.475231:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663863168 00000100:00100000:1.0:1790779258.475251:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663863168 00000100:00100000:1.0:1790779258.475305:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790779258.475314:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3652:x1877767663863168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779258.475394:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3652:x1877767663863168:12345-0@lo:400:kworker.0 Request processed in 80us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779258.475401:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1790779258.475589:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f89954ec-b1b4-4b66-a198-81b81a38f825:3652:1877767663863168:0@lo:400:kworker.0 00000100:00100000:3.0:1790779258.481806:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663864960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779258.481947:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.482012:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790779258.482021:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663864832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779258.482048:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779258.482091:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663864960 00000100:00100000:3.0:1790779258.482102:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663864960 00000100:00100000:3.0:1790779258.482154:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663864832 00000100:00100000:3.0:1790779258.482157:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663864832 00000100:00100000:3.0:1790779258.482175:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790779258.482185:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663864960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790779258.482239:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790779258.482309:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663864960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.482318:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790779258.482337:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790779258.482343:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663864832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779258.482352:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790779258.482374:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663864832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779258.482380:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790779258.482429:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663864832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779258.482445:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76045fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663864960:0@lo:13:osp-pre-1-0.0 Debug log: 42565 lines, 42565 kept, 0 dropped, 0 bad.